-
Notifications
You must be signed in to change notification settings - Fork 73
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Opening virtual datasets with NASA dmrpp files #605
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The idea is to speed up opening up netcdf4/hdf5 datasets with a NASA specific optimization. Load data like
xr.open_mfdataset
with kerchunk/zarr speeds by translating existing dmr++ metadata files to zarr metadata on the fly. Much more context and discussion here.virtualizarr
PR for the parser hereearthaccess
PR hereearthaccess
additions:xarray
s concatenation logic to create virtual views of netcdf’s (more details invirtualizarr
documentation)zarr
engine inxarray
to load a dataset (with indexes)Questions/Suggestions:
Changes to the API?
NASA datasets you want me to test?
MUR-JPL-L4-GLOB-v4.1
(netcdf),SWOT_SSH_2.0
(netcdf),ATL-03
ICE-SAT (hdf5)Take a look at the virtualizarr parser PR and leave suggestions
ET.fromstring(dmr_str)
since thexml.ElementTree
library needs to read the text, validate the xml, and create a parsable object. I am looking into a non-validating parser likexml.parsers.expat
The text was updated successfully, but these errors were encountered: