| 1 | = Information about the batch system = |
| 2 | |
| 3 | == Ressource allocation == |
| 4 | |
| 5 | * Start an interactive session for example on one DEEP Cluster Node for 2.5 hours: |
| 6 | -> ''qsub -I -X -l nodes=1:ppn=16:cluster,walltime=02:30:00'' |
| 7 | * Leave the interactive session: |
| 8 | -> ''exit'' |
| 9 | * Submit a batch job: |
| 10 | -> ''qsub job_script.sh'' |
| 11 | * Specify the nodes you want to use: |
| 12 | -> ''-l nodes=x:ppn=y:cluster'' will allocate DEEP Cluster Nodes \\ |
| 13 | -> ''-l nodes=x:ppn=y:booster'' will allocate DEEP Booster Nodes\\ |
| 14 | -> ''-l nodes=x:ppn=y:sdv'' will allocate SDV Cluster Nodes\\ |
| 15 | -> ''-l nodes=x:ppn=y:knl'' will allocate (randomly) SDV KNL Nodes\\ |
| 16 | -> ''-l nodes=x:ppn=y:knl:extoll'' will allocate SDV KNL Nodes with EXTOLL\\ |
| 17 | -> ''-l nodes=x:ppn=y:knl:nvme'' will allocate SDV KNL Nodes with NVMe\\ |
| 18 | * The following job script can be used as a template for your own jobs: |
| 19 | |
| 20 | {{{ |
| 21 | #!/bin/bash |
| 22 | #PBS -S /bin/bash |
| 23 | #PBS -l nodes=[number of nodes]:ppn=[number of processes per node]:[nodetype] |
| 24 | #PBS -l walltime=[hours]:[minutes]:[seconds] |
| 25 | #PBS -e [path to your errorfiles] |
| 26 | #PBS -o [path to your outputfiles] |
| 27 | #PBS -m e |
| 28 | #PBS -M [your mail address] |
| 29 | #PBS -N [name of your program] |
| 30 | #PBS -d [path to your working directory] |
| 31 | #PBS -v LD_LIBRARY_PATH |
| 32 | module load parastation |
| 33 | [load all the modules you need] |
| 34 | mpiexec -np [number of processes] [executable] |
| 35 | }}} |
| 36 | |
| 37 | |
| 38 | == Some useful commands == |
| 39 | |
| 40 | * ''pbstop'' -> Shows system load and job overview.[[BR]] |
| 41 | * ''pbsnodes -nl'' -> Shows information on nodes, that are currently not available.[[BR]] |
| 42 | * ''showres'' -> Shows reservations. (Only on deepm) [[BR]] |
| 43 | * ''showq'' -> Lists active, idle and blocked jobs. (Only on deepm) [[BR]] |
| 44 | * ''qstat -u USER'' -> Shows jobs of a certain user.[[BR]] |
| 45 | * ''qstat -f JOBID'' -> Shows detailed information about a certain job (job id can be obtained by qstat -u).[[BR]] |
| 46 | * ''showstart JOBID'' -> Provides an estimated start time for a certain job. (Only on deepm) |