Changes between Version 43 and Version 44 of Public/User_Guide/Batch_system

Timestamp:

Mar 2, 2021, 10:37:44 AM (3 years ago)

Author:

Marco D'Amico

Comment:

First description of module-list policy

Public/User_Guide/Batch_system

@@ -567 +567 @@
 When using the library, the header file can be included using `#include <slurm/slurm_workflow.h>` and the library should be linked against using `-lslurm_workflow -lslurm`.
 
+== Submitting jobs to alternative modules ==
+Users can submit batch jobs to multiple modules by using `--module-list` extension for Slurm `sbatch` command. This extension accepts two modules, a primary module, submitted with higher priority, and an alternative module that receives a lower priority in the job queue. In the below example the job is submitted to two modules: the primary module is dp-cn, while the secondary module is dp-dam.
+
+`sbatch --module-list=dp-cm,dp-dam job.batch`
+
+The parameters for the alternative module are automatically calculated by using an internal conversion model. Module-list is an alternative to `--partition`, which does not apply any conversion model, and submits the job to multiple partitions but with the same configuration. Available conversion models: 
+ - CM to DAM: number of requested nodes / 2, number of tasks per node x2, time limit *1.07
+ - ESB to CM: same number of nodes, time limit * 10
+ - DAM to CM: number of nodes * 2, time limit * 10
+ - DAM to ESB: ntasks per node / 8, number of nodes * 4, time limit / 4
+
+Module-list is currently not compatible with other dependencies specified with `--dependency` clause, and also with other partitions specified with `--partition`.
 
 == Information on past jobs and accounting ==