Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ticket downloads not thread-safe #365

Open
joergsteinkamp opened this issue Oct 2, 2024 · 5 comments
Open

Ticket downloads not thread-safe #365

joergsteinkamp opened this issue Oct 2, 2024 · 5 comments
Labels
Milestone

Comments

@joergsteinkamp
Copy link
Contributor

Dear Kory and colleagues,

as hypothized in our previous issue ticket downloads are not thread safe. If I start a second download shortly before the first is finished, the second download fails with a "500 - Sever Internal Error", since the cached file got deleted by the first download thread.
Since irods-rest is not available anymore and irods_client_http_api does not (yet?) provide ticket access, at least I didn't find it, we rely on metalnx ticket access to provide public access to scientific data.

Thanks & kind regards,
Jörg

@trel
Copy link
Contributor

trel commented Oct 2, 2024

ticket access is available via HTTP API

https://github.com/irods/irods_client_http_api/blob/main/API.md#read

@trel trel added the bug label Oct 2, 2024
@joergsteinkamp
Copy link
Contributor Author

Thanks Terrell and sorry that I didn't find it myself.

@trel
Copy link
Contributor

trel commented Oct 2, 2024

That will get you streaming - so if you want parallel performance, you'll have to manage multiple threads with offsets on the client side (at the moment). Good ideas welcome for how to make that better.

@joergsteinkamp
Copy link
Contributor Author

Hi Terrell, but irods_client_http_api is only possible with authentication, if I get it right. How about anonymous access to data published via tickets? Or did I again oversee something?

@trel
Copy link
Contributor

trel commented Oct 4, 2024

You can use a ticket with anonymous and an empty password if the anonymous user exists in the Zone.

I believe this is the same requirement / use as how metalnx uses tickets now.

@trel trel added this to the Backlog milestone Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Development

No branches or pull requests

2 participants