Submission tools for batch job management (CERN HT-Condor)

How-to submit jobs

Inline help:

python submit.py --help

Create the Job configuration using the command:

python submit.py -f submit.cfg --create

Submit the jobs to the queues via the command:

python submit.py -f submit.cfg --submit

Configuration file

The conf file uses the ini format. You can find several examples in this directory. Most of the parameters should be self explenatory. Each task corresponds to a sample and will be mapped to a dedicated condor cluster. Input files can be specified via the dataset name using input_dataset or via the directory where the files sit using input_directory. The implemented input splitting modes are: file_based and lumi_based (in the sense of LS). For the job_flavor and other condor parameters please refer to the CERN Condor documentation

How to modify the template structure

If you want to add a new set of templates you need to define a new mode (MODE) in:

https://github.com/cerminar/submission/blob/master/submit.py#L101

Note the code assumes that all keys starting with TEMPL_ are variables in the templated files that need to be replaced.

And create the corresponding template files in the directory templates/

You need 1 or 2 templated files:

1. condorSubmit_MODE.sub: this defines the structure of the Condor submission file. If you don't need to modify it you can use the condorSubmit_DEFAULT.sub one (see CERN Condor documentation);
2. jobCustomization_MODE_cfg.py. which defines what needs to be changed for each job of the cluster.
3. run_MODE.sh: this is the script which actually gets executed on the node, setups the config and calls cmsRun. Again a run_DEFAULT.sh exists and should work for most cases.