Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cmip6 kerchunk #82

Merged
merged 7 commits into from
Oct 6, 2023
Merged

Add cmip6 kerchunk #82

merged 7 commits into from
Oct 6, 2023

Conversation

abarciauskas-bgse
Copy link
Contributor

@abarciauskas-bgse abarciauskas-bgse commented Oct 5, 2023

Documentation for CMIP6 Kerchunk Demo data. Once this is merged I could include links in the final dataset page in the dashboard. I will be updating the STAC notebook to use the staging API and probably using DEMO in place of TEST

Copy link
Contributor

@j08lue j08lue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Almost too valuable to just sit here in veda-data and not in veda-docs...

As this pattern of integrating Zarr data hardens, we should document it more publicly, too.

@slesaad
Copy link
Member

slesaad commented Oct 5, 2023

definitely agree with @j08lue here, we should probably also put this in veda-docs!

@abarciauskas-bgse
Copy link
Contributor Author

abarciauskas-bgse commented Oct 5, 2023

Thanks @slesaad @j08lue should I go ahead and open this change to veda-docs (I'm assuming in https://nasa-impact.github.io/veda-docs/contributing/dataset-ingestion/) or should it also be in this repo?

Sidebar: In the future, we plan to have pangeo forge recipes and bakeries for generating kerchunk, however in this case using dask works well because it's not a dataset that gets regularly updated.

@slesaad
Copy link
Member

slesaad commented Oct 5, 2023

I'd say keep in both? what do you think @j08lue ?

@j08lue
Copy link
Contributor

j08lue commented Oct 6, 2023

Sure!

@abarciauskas-bgse abarciauskas-bgse merged commit 73b5c86 into main Oct 6, 2023
1 check passed
@gadomski gadomski deleted the add-cmip6-kerchunk branch October 9, 2023 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants