Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tweak interface for integration into atmos #77

Merged
merged 31 commits into from
May 3, 2024
Merged

Conversation

nefrathenrici
Copy link
Member

@nefrathenrici nefrathenrici commented Apr 10, 2024

This PR removes the sbatch scripts and replaces them with a julia interface for running calibration in src/slurm_interface.jl.

This has been replaced by a julia interface which schedules and handles sbatch jobs, located in src/backends.jl.
We now have two calibrate methods that dispatch on differing AbstractBackends, which specify the "backend" to use for a calibration run. There are two backends: Julia and CaltechHPC.

Additional Content

  • Use experiment directories instead of experiment ID for ExperimentConfig constructor. This allows for calibrations to run from an arbitrary location instead of assuming the experiment folders are in the working directory
  • Remove sphere HS example
  • Move postprocessing/plotting funcs
  • Update docs
  • Add pipeline to test slurm calibration
  • Update SF calibration experiment to work with new interface
  • Update pipeline.jl
  • Add hooks for obtaining ENV variables. This can be useful for passing information to individual processes running forward models.

@nefrathenrici nefrathenrici changed the title Ne/integrate atmos Tweak interface for integration into atmos Apr 10, 2024
@nefrathenrici nefrathenrici merged commit fe403ea into main May 3, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant