You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, FlyteFile and FlyteDirectory objects with a non-default _downloader function (i.e. a _downloader that isn't the default noop function) cannot be pickled.
File "/opt/micromamba/envs/runtime/lib/python3.11/multiprocessing/reduction.py", line 60, in dump
ForkingPickler(file, protocol).dump(obj)
AttributeError: Can't pickle local object 'FlyteDirToMultipartBlobTransformer.async_to_python_value.<locals>._downloader'
Message:
AttributeError: Can't pickle local object 'FlyteDirToMultipartBlobTransformer.async_to_python_value.<locals>._downloader'
This error is raised when, e.g. users specify FlyteDirectory/File task inputs together with the Elastic plugin, which relies on pickling the inputs when running the task function code in parallel.
Expected behavior
This should just work.
Additional context to reproduce
No response
Screenshots
No response
Are you sure this issue hasn't been raised already?
Yes
Have you read the Code of Conduct?
Yes
The text was updated successfully, but these errors were encountered:
Describe the bug
Currently,
FlyteFile
andFlyteDirectory
objects with a non-default_downloader
function (i.e. a_downloader
that isn't the defaultnoop
function) cannot be pickled.This error is raised when, e.g. users specify
FlyteDirectory/File
task inputs together with theElastic
plugin, which relies on pickling the inputs when running the task function code in parallel.Expected behavior
This should just work.
Additional context to reproduce
No response
Screenshots
No response
Are you sure this issue hasn't been raised already?
Have you read the Code of Conduct?
The text was updated successfully, but these errors were encountered: