Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Identify Core Datasets needed to run the recipes #314

Open
rbeucher opened this issue Jan 29, 2024 · 5 comments
Open

Identify Core Datasets needed to run the recipes #314

rbeucher opened this issue Jan 29, 2024 · 5 comments
Assignees

Comments

@rbeucher
Copy link
Contributor

While working on the CI/CD and on the conversion of the recipes to use the intake catalog, I noticed that a lot of data is stored in hh5 and ik11.

I propose that the MED team put together a list of the datasets needed to run the recipes.
We can then discuss a plan to consolidate and support the data.

@rbeucher
Copy link
Contributor Author

@max-anu, I believe you have made a list somewhere.

@adele-morrison
Copy link
Collaborator

Good idea to think about this @rbeucher. In many cases it is somewhat arbitrary what data is used in the recipes, and in some we've tried to use lower res model output so that the recipes run faster.

If ACCESS-NRI has the capacity to store and maintain some of the COSIMA data on ik11/ol01/cj50 that would be great. Though perhaps it is more useful to think about which data is used most by the community, rather than what data is currently used in the COSIMA recipes. It would be easy to switch simulations in the recipes where needed.

@rbeucher
Copy link
Contributor Author

@max-anu, @paigem should be able to help with this.

@adele-morrison, I can see there are some re-gridded WOA datasets. Is it something that would be worth adding to the ACCESS-NRI replicas collection for model evaluation?
We could create a COSIMA sub-collection and start adding observation datasets.

See here for what we currently have for ESMValTool and ILAMB: https://geonetwork.nci.org.au/geonetwork/srv/eng/catalog.search#/metadata/f7199_2480_5432_9703

@paigem
Copy link

paigem commented Feb 14, 2024

@rbeucher Happy to help with this! I can go through and make a list of the datasets currently used in the COSIMA recipes.

@adele-morrison I may reach out to you once I have the list to provide input on which datasets could be updated to be more useful to the COSIMA community.

@adele-morrison
Copy link
Collaborator

@rbeucher WOA is definitely a useful one to have in the COSIMA sub-collection of obs datasets for model evaluation. In the past we've found it useful to have this pre-interpolated onto the various ACCESS-OM2 resolutions, so people don't have to redo the interpolation themselves all the time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants