System usage

The system can be used through the PBS based batch system that is also used for the DEEP Cluster and Booster. You can request cluster nodes on the SDV with an interactive session like this:

kreutz@deepl:~ > qsub -I -l nodes=2:ppn=24:sdv,walltime=01:00:00
qsub: waiting for job 76649.deepm to start
qsub: job 76649.deepm ready

kreutz@deeper-sdv16:~ >

To use the SDV Cluster nodes (8 nodes) reserved for the DEEP-ER people (every day from 8:30am-5:00pm) please use:

qsub -q deeper-sdv -l nodes=X:ppn=Y:knl,walltime=...

When using a batch script, you have to adapt the -l (-q) option within your script.

Filesystems and local storage

The home filesystems on the SDV are provided via GPFS/NFS and hence the same as on the DEEP System. The local storage system of the SDV running BeeGFS is available at

/sdv-work

This is NOT the same storage being used on the DEEP system. Both, the DEEP System and the DEEP-ER SDV have their own local storage. On the DEEP nodes it is mounted to /work on the deeper-sdv nodes it can be found in /sdv-work. In addition both systems provide a work filesystem via GPFS, which is called /gpfs-work and shared for both systems. But it should not be used for performance relevant applications since it is much slower than the local storages.

Using /nvme

During job startup, all files of non-priviledged users within /nvme are removed. If you want to keep your files across consecutive jobs on a particular SDV node, add a list of filenames to $HOME/.nvme_keep:

/nvme/tmp/myfile.A
/nvme/tmp/myfile.B

This will keep the files /nvme/tmp/myfile.{A,B} across two or more job runs in a row.