-
Notifications
You must be signed in to change notification settings - Fork 76
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Permissions error when downloading files from OPERA_L2_RTC-S1_V1 dataset on ASF DAAC (but not OPERA_L3_DIST-ALERT-HLS_PROVISIONAL_V0 on LP DAAC) #439
Comments
🎉 Thanks for the report! I believe the issue is that this dataset has an End User License Agreement (EULA) that must be accepted. We need to work on our error message for this so users can more easily resolve this issue on their own (#36). Can you please try visiting a granule URL in your browser (https://datapool.asf.alaska.edu/RTC/OPERA-S1/OPERA_L2_RTC-S1_T098-209157-IW3_20240129T101603Z_20240129T135204Z_S1A_30_v1.0_HH.tif) and navigate through the EULA, then try using earthaccess again and let us know if that helps? |
Thank you for the information! I have downloaded OPERA RTC data using the ASF Data Search Vertex in the past, and I agreed to the ASF EULA at that time. The granule you linked downloads automatically when clicked, but the issue persists when trying to access RTC data with earthaccess. Regarding permissions, would there need to be something added to the .netrc file that would indicate the user has already agreed to the EULA? |
Shoot! That was my best guess :) @betolink thoughts on how to debug deeper? There should be no |
I'm trying to get to one of the files directly with curl -Lv -H "Authorization: Bearer $EDL_TOKEN" https://datapool.asf.alaska.edu/RTC/OPERA-S1/OPERA_L2_RTC-S1_T136-290176-IW3_20231004T002039Z_20240123T060856Z_S1A_30_v1.0_mask.tif |
ASF has a However, If you hit cumulus directly, it works:
The curl command above also works if you add On the ASF side, to eliminate the need for users/applications/libraries to handle this bit of fun themselves, we'd have to either:
Notably, basic auth with a |
Notably, for the And the suggestion from @asjohnston-asf who talked me through what's happening here is:
But I don't know that we want Earthaccess to have to know that much about each DAAC |
💯 |
I'll take a look at possible solutions so we can have all the ASF catalog available in earthaccess. |
Hi @cmspeed We just merged a PR that fixes access to all OPERA products (or so we think). If you don't want to wait for the next release you can install the library from the repo and test if the fix works for you. pip install git+https://github.com/nsidc/earthaccess.git@main Maybe you'll need to uninstall first and then install it. Looking forward to the results you get! |
Hi @betolink - Apologies for delay in circling back to this. Things are now working on my end with the ASF-hosted datasets after the update. Thanks for your work on this (and earthaccess in general). Really good stuff! |
I am attempting to download a few granules from the OPERA_L2_RTC-S1_V1 dataset using the following:
Even though the initial authentication step seems to be working as it should, I am encountering the following HTTP 401 error (for every granule):
Interestingly, the same syntax applied to a different OPERA dataset doesn't produce the same error, and the files are downloaded as expected.
A key difference between these datasets is that the OPERA RTC product is distributed by ASF DAAC whereas the OPERA DIST-ALERT product is distributed by LP DAAC. I am wondering if the issue may stem from a difference in the way that earthaccess requests these files from the two DAACs. I am relatively new to this means of data access, so any guidance would be much appreciated!
The text was updated successfully, but these errors were encountered: