Changes between Version 13 and Version 14 of Public/User_Guide/DEEP-EST_CM


Ignore:
Timestamp:
Jul 8, 2022, 4:03:32 PM (22 months ago)
Author:
Jochen Kreutz
Comment:

Small updates

Legend:

Unmodified
Added
Removed
Modified
  • Public/User_Guide/DEEP-EST_CM

    v13 v14  
    33= System usage =
    44
    5 The DEEP-EST Cluster Module (CM) can be used through the SLURM based batch system that is also used for the DAM and ESB modules and (most of) the Software Development Vehicles (SDV). You can request CM cluster nodes (`dp-cn[01-50]`) on the with an interactive session like this:
     5The DEEP-EST Cluster Module (CM) can be used through the SLURM based batch system that is also used for the DAM and ESB modules and (most of) the Software Development Vehicles (SDV). You can request CM cluster nodes (`dp-cn[01-50]`) with an interactive session like this:
    66
    77{{{
     
    3030
    3131In addition, the older SSSM storage system provides the `/usr/local` filesystem on the CM compute nodes running BeeGFS as well.
    32 There is a gateway being used to bridge between the Infiniband EDR used for the CM and the 40 GbE network the SSSM file servers are connected to.
    3332
    3433There is also some node local storage available for the DEEP-EST Cluster nodes mounted to `/scratch` on each node (about 380 GB with XFS). Remember that this scratch is not persistent and **will be cleaned after your job has finished** !
     
    4443}}}
    4544
    46 For using Cluster nodes in heterogeneous jobs together with DAM nodes, please see info about [wiki:Public/User_Guide/Modular_jobs heterogeneous jobs]. Currently (as of 2020-04-03) the ESB racks 2 and 3 are equipped with IB and directly connected to the CM nodes. Hence, no gateway has to be used when running on CM and ESB nodes. The first rack is planned to be modified to use IB as well (instead of currently installed Extoll Fabri³ solution).
     45For using Cluster nodes in heterogeneous jobs with DAM and ESB nodes no gateway has to be used (anymore), since all 3 compute modules (as well es the login and file servers) are using EDR Infiniband as interconnect.