You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Take the list of publishers/files from the registry
In each multiprocess take one of the entries from the list and add the metadata information
recreate the list of publishers/files from the registry from the returned results of (2)
If something goes wrong we should return the original entry from the registry to rebuild the list, this is done by catching all the exceptions and returning the original data. This is fine.. but we don't want to rely on that mechanism, especially in the case where one of those multiprocesses gets terminated without an exception but doesn't terminate the parent process (if that is even possible).
The text was updated successfully, but these errors were encountered:
In https://github.com/ThreeSixtyGiving/datagetter/blob/master/getter/get.py#L297 we currently
If something goes wrong we should return the original entry from the registry to rebuild the list, this is done by catching all the exceptions and returning the original data. This is fine.. but we don't want to rely on that mechanism, especially in the case where one of those multiprocesses gets terminated without an exception but doesn't terminate the parent process (if that is even possible).
The text was updated successfully, but these errors were encountered: