Skip to content

Commit

Permalink
move gpu pipeline to clima
Browse files Browse the repository at this point in the history
  • Loading branch information
sriharshakandala committed Sep 22, 2023
1 parent d6b24c0 commit 7d403c3
Showing 1 changed file with 2 additions and 10 deletions.
12 changes: 2 additions & 10 deletions .buildkite/gpu_pipeline/pipeline.yml
Original file line number Diff line number Diff line change
@@ -1,26 +1,18 @@
agents:
queue: central
queue: clima
slurm_mem: 8G
modules: julia/1.9.3 cuda/11.8 ucx/1.14.1_cuda-11.8 openmpi/4.1.5_cuda-11.8 hdf5/1.12.2-ompi415 nsight-systems/2023.2.1
modules: julia/1.9.3 cuda/julia-pref openmpi/4.1.5-cuda

env:
JULIA_LOAD_PATH: "${JULIA_LOAD_PATH}:${BUILDKITE_BUILD_CHECKOUT_PATH}/.buildkite"
OPENBLAS_NUM_THREADS: 1
JULIA_NVTX_CALLBACKS: gc
OMPI_MCA_opal_warn_on_missing_libcuda: 0
JULIA_MAX_NUM_PRECOMPILE_FILES: 100
JULIA_DEPOT_PATH: "${BUILDKITE_BUILD_PATH}/${BUILDKITE_PIPELINE_SLUG}/depot/cpu"
GPU_CONFIG_PATH: "config/gpu_configs/"

steps:
- label: "init :GPU:"
key: "init_gpu_env"
command:
- "echo $$JULIA_DEPOT_PATH"

- echo "--- Configure MPI"
- julia -e 'using Pkg; Pkg.add("MPIPreferences"); using MPIPreferences; use_system_binary()'

- echo "--- Instantiate project"
- "julia --project -e 'using Pkg; Pkg.instantiate(;verbose=true)'"
- "julia --project -e 'using Pkg; Pkg.precompile()'"
Expand Down

0 comments on commit 7d403c3

Please sign in to comment.