Remove old diagnostics and ClimaAnalysis

[Sbozzolo]

Highlight of the changes:

• Remove old diagnostics and post_processing pipelines
• Use ClimaAnalysis to make plots for buildkite runs
• Tar up artifacts so that it is easier to find the summary plots
• Summary plots are now multi-page PDFs
• Remove the diagnostics from the HDF5 restart files
• Remove restart and rename functions (now that the diagnostics are removed from the HDF5 files, there is no longer any difference between a restart and a normal HDF5 file). This is a breaking change.

This pull request the post-processing pipelines are (for the most part) moved to using ClimaAnalysis. ClimaAnalysis takes care of all the file processing and reading and provides rudimentary plotting capabilities (when loaded with CairoMakie).

Going forward, there's going to be a unified way to produce plots for buildkite runs, with each job getting its post-processing function.

The entire post-processing pipeline has been condensed to a single file: ci_plots.jl. This file defines methods for the function

make_plot(::Val{jobid}, simulation_path)

where jobid is the id of the job for which the plots have to be produced.

For example, the function for the single column runs are:

ColumnPlots = Union{
    Val{:single_column_hydrostatic_balance_ft64},
    Val{:single_column_radiative_equilibrium_gray},
    Val{:single_column_radiative_equilibrium_clearsky},
    Val{:single_column_radiative_equilibrium_clearsky_prognostic_surface_temp},
    Val{:single_column_radiative_equilibrium_allsky_idealized_clouds},
}

function make_plots(::ColumnPlots, simulation_path)
    simdir = SimDir(simulation_path)
    short_names, reduction, period = ["ta", "wa"], "average", "1d"
    vars = [
        get(simdir; short_name, reduction, period) for short_name in short_names
    ]
    make_plots_generic(
        simulation_path,
        vars,
        time = LAST_SNAP,
        x = 0.0, # Our columns are still 3D objects...
        y = 0.0,
    )
end

Most post-processing steps will look like this. make_plots_generic is a new function defined in ci_plots that drives CairoMakie Figure/Axis creating and uses CairoMakieExt in ClimaAnalysis for heatmap or line plots (automatically selected depending on the dimensionality of the variable) and pages the output. The output is saved in temporary PDFs, which are all merged together to produce a multi-page PDF. To do so, I added Poppler_jll to the example environment.

Another change is with the buildkite artifacts. I collected all the files in two tar archives so that only up to three files are uploaded. This makes finding the summary.pdf easy and quick (otherwise one would have to hunt that file). To do so, I added Tar.jl as an explicit dependency to the example environment. Note that Tar.jl is required by Pkg.

[Sbozzolo]

@charleskawczynski @szy21 @akshaysridhar I addressed the comments, feel free to have a look again when you have the chance.

[szy21]

Thanks! Just a few more minor comments.

[akshaysridhar]

There seems to be a typo in MoisHeldSuarezPlots > MoistHeldSuarezPlots which is breaking one or more of the buildkite runs.

[Sbozzolo]

There seems to be a typo in MoisHeldSuarezPlots > MoistHeldSuarezPlots which is breaking one or more of the buildkite runs.

Thanks!