This repository contains example Pegasus workflows that execute on the Cerebras machine at PSC called Neocortex. The examples are for some of the models in the modelzoo that Cerebras has made availble for users to run.
The workflows in this repository validate, compiles and trains the model.
At the moment we have example workflows for
- Tensor Flow
- PyTorch
The workflow is based on the example at Running Jobs on Neocortex .
- Install HTCondor
- Install Pegasus WMS
You can also refer to the overview on deployment options and select what works best for your setup.
All the jobs are run via a Cerebras provided singularity container that is available on the shared filesystem.