Changes between Initial Version and Version 1 of Public/User_Guide/DEEP-EST_DAM


Ignore:
Timestamp:
Aug 7, 2019, 9:14:46 AM (5 years ago)
Author:
Jochen Kreutz
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Public/User_Guide/DEEP-EST_DAM

    v1 v1  
     1= System usage =
     2
     3The DEEP-EST Data Analytics Module (DAM) can be used through the SLURM based batch system that is also used for (most of) the Software Development Vehicles (SDV). You can request DAM nodes (`dp-dam[01-16]` with an interactive session like this:
     4
     5{{{
     6srun -N 4 -n 2 -p dp-dam --time=1:0:0 --pty /bin/bash -i
     7[kreutz1@dp-dam01 ~]$ srun -n 8 hostname
     8dp-dam01
     9dp-dam01
     10dp-dam01
     11dp-dam01
     12dp-dam02
     13dp-dam02
     14dp-dam02
     15dp-dam02
     16}}}
     17
     18
     19When using a batch script, you have to adapt the partition option within your script: `--partition=dp-dam`
     20
     21**Attention:** Module environment is not configured properly yet.
     22
     23== Using Cuda ==
     24
     25To compile and run Cuda applications on the Nvidia V100 cards included in the DAM nodes, it might be necessary to use an older GCC version since GCC 8.3.0 is not supported with installed Cuda 10 version:
     26
     27{{{
     28export PATH=/usr/local/cuda/bin:$PATH
     29export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBARY_PATH
     30export PATH=/usr/local/software/skylake/Stages/2018b/software/GCCcore/7.3.0/bin
     31}}}
     32
     33
     34== Filesystems and local storage ==
     35
     36The home filesystem on the DEEP-EST Cluster Module is provided via GPFS/NFS and hence the same as on (most of) the remaining compute nodes.
     37The local storage system of the DAM running BeeGFS is available at
     38{{{
     39/work
     40}}}
     41The file servers are reachable through the 40 GbE interface of the DAM nodes.
     42
     43This is NOT the same storage being used on the DEEP-ER SDV system. Both, the DEEP-EST prototype system and the DEEP-ER SDV have their own local storage.   
     44
     45It's possible to access the local storage of the DEEP-ER SDV (`/sdv-work`), but you have to keep in mind that the file servers of that storage can just be accessed through 1 GbE ! Hence, it should not be used for performance relevant applications since it is much slower than the DEEP-EST local storages mounted to `/work`.
     46
     47There is node local storage available for the DEEP-EST DAM node (2 x 1.5 TB NVMe SSD), but configuration is to be done for those devices.
     48
     49== Multi-node Jobs ==
     50
     51
     52**Attention:** Since the Extoll network is not in place yet multi-node MPI Jobs are currently disabled.
     53{{{#!comment
     54
     55Loading the most recent ParaStation module will be enough to run multi-node MPI jobs over Extoll
     56
     57{{{
     58module load ParaStationMPI
     59}}}
     60
     61}}}