Changes between Version 18 and Version 19 of Public/User_Guide/DEEP-EST_DAM


Ignore:
Timestamp:
Jul 14, 2022, 10:52:15 AM (23 months ago)
Author:
Jochen Kreutz
Comment:

Update PMEM info and interacive session example

Legend:

Unmodified
Added
Removed
Modified

  • Public/User_Guide/DEEP-EST_DAM

    v18 v19  
    22
    33= System usage =
    4 The DEEP-EST Data Analytics Module (DAM) can be used through the SLURM based batch system that is also used for (most of) the Software Development Vehicles (SDV). You can request DAM nodes (`dp-dam[01-16]`) with an interactive session like this:
     4The DEEP-EST Data Analytics Module (DAM) can be used through the SLURM based batch system that is also used for (most of) the Software Development Vehicles (SDV). You can request a DAM node (`dp-dam[01-16]`) with an interactive session like this:
    55
    66{{{
    7 srun -A deep -N 4 --tasks-per-node 2 -p dp-dam --time=1:0:0 --pty /bin/bash -i
    8 [kreutz1@dp-dam01 ~]$ srun -n 8 hostname
     7srun -A deepsea -N 1 --tasks-per-node 4 -p dp-dam --time=1:0:0 --pty --interactive /bin/bash
     8kreutz1@dp-dam01 ~]$ srun -n 8 hostname
    99dp-dam01
    1010dp-dam01
    11 dp-dam02
    12 dp-dam02
    13 dp-dam03
    14 dp-dam03
    15 dp-dam04
    16 dp-dam04
     11dp-dam01
     12dp-dam01
    1713}}}
    18 When using a batch script, you have to adapt the partition option within your script: `--partition=dp-dam`
     14
     15When using a batch script, you have to adapt the partition option within your script: `--partition=dp-dam` (or short form: `-p dp-dam`)
    1916
    2017== Persistent Memory ==
    2118
    2219Each of the DAM nodes is equipped with [https://www.intel.com/content/www/us/en/architecture-and-technology/optane-dc-persistent-memory.html Intel's Optane DC Persistent Memory Modules] (DCPMM).
    23 Whereas the first two nodes (`dp-dam[01,02]`) expose 3 TB of persistent memory the remaining nodes (`dp-dam03-16]`) have 1.5 TB of persistent memory included.
     20All DAM nodes (`dp-dam[01-16]`) expose 3 TB of persistent memory.
    2421
    2522The DCPMMs can be driven in different modes. For further information of the operation modes and how to use them, please refer to the following [https://github.com/pmemhackathon/2019-11-08 information]
    2623
     24Currently all nodes are running in "App Direct Mode".
     25{{{#!comment not working
    2726DCPMM modes have been added to check which nodes are running in which mode, you can use the `scontrol` command:
    28 
    2927{{{
    3028scontrol show node dp-dam01 | grep AvailableFeatures
    3129}}}
     30
    3231
    3332To select a node using a certain memory mode, you can use the constraint option within SLURM, e.g.:
    … …  
    3534{{{
    3635srun -p dp-dam -N 1 -c 24 -t 0:30:0 --constraint=dpcmm_mem --pty /bin/bash
     36}}}
    3737}}}
    3838