Skip to content

v1.1.0
Compare
Choose a tag to compare
@kennyworkman kennyworkman released this 07 Jun 02:39
· 2499 commits to main since this release
v1.1.0
8d8349f
  • LatchFile/LatchDir objects can consume s3 URLs as valid paths.
  • These objects will only download data within a task context if (1) there is an implicit call to __fsopen__ (eg. open(LatchFile)) or (2) the local_path attribute is referenced.

File data will no longer be copied to task machine by default. Primarily motivated by cases when the Latch* objects are used to type fields in Records or similar complex values and only subset of fields are used/or path literal is used without desire for file data itself. We want to avoid wasted copy in such contexts.

Assets 2
Loading