Changes between Version 48 and Version 49 of Public/User_Guide/System_overview

Timestamp:

Jan 3, 2025, 12:06:03 PM (4 months ago)

Author:

Jochen Kreutz

Comment:

—

Public/User_Guide/System_overview

@@ -5 +5 @@
 
 {{{#!comment
-[[span(style=color: #FF0000, **Last Update:** )]] 2022-01-06
+[[span(style=color: #FF0000, **Last Update:** )]] 2024-01-03
 }}}
 
@@ -75 +75 @@
 }}}
 
+{{{#!comment
 === Scalable Storage Service Module ===
 It is based on spinning disks and composed of 4 volume data server systems, 2 metadata servers and 2 RAID enclosures. The RAID enclosures each host 24 spinning disks with a capacity of 8 TB each. Both RAIDs expose two 16 Gb/s fibre channel connections, each connecting to one of the four file servers. There are 2 volumes per RAID setup. The volumes are driven with a RAID-6 configuration. The BeeGFS global parallel file system is used to make 292 TB of data storage capacity available.
@@ -91 +92 @@
    * 2 x 16 Gb FC connector
 }}}
+
+
 {{{#!td
 [[Image(SSSM.png, width=600px, align=center)]]
+}}}
 }}}
 
@@ -104 +108 @@
    * 2 Intel Xeon Scalable Gold 6246 (12 cores (24 threads), 3.30 GHz)
    * 192 GB RAM
-   * 
    * 25.6 TB SSD PCIe3 NVMe (using 8 x 3.2 TB Intel SSD DC P4610)
    * network: 1 x 100 Gbps EDR-!InfiniBand HCA (PCIe3 x16)
@@ -110 +113 @@
    * 2 Intel Xeon Scalable Gold 6226R (16 cores (32 threads), 2.90 GHz)
    * 384 GB RAM
-   * 
    * 308 TB SSD PCIe3 NVMe (using 24 x 15.36 TB Intel SSD DC P4326)
    * network: 1x 100 Gbps EDR-!InfiniBand HCA (PCIe3 x16)
@@ -143 +145 @@
 Along with the actual prototype system several test nodes and so called software development vehicles (SDVs) have been installed in the scope of the DEEP(-ER,EST) projects. These are located in the SDV rack (07). KNL and ml-GPU nodes can be accessed by the users via SLURM. Access to the remaining SDV nodes can be given on demand:
 
+ * KNLs [4 nodes]: `knl[01,04-06]`
+   * 1 Intel Xeon Phi (64-68 cores)
+   * 1 NVMe with 400 GB per node (accessible through BeeGFS on demand)
+   * 16 GB MCDRAM plus 96 GB RAM per KNL
+   * network: 1 Gigabit Ethernet
+
  * Prototype DAM [4 nodes]: `protodam[01-04]`
    * 2 x Intel Xeon 'Skylake' (26 cores per socket)
@@ -148 +156 @@
    * network: 1 Gigabit Ethernet
 
- * Old DEEP-ER Cluster Module SDV [10 nodes]: `deeper-sdv[01-10]`
+ * Old DEEP-ER Cluster Module SDV [5 nodes]: `deeper-sdv[01-05]`
    * 2 Intel Xeon 'Haswell' E5-v2680 v3 (2.5 GHz)
    * 128 GB RAM
-   * 1 NVMe with 400 GB per node( accessible through BeeGFS on demand)
-   * network: 1 Gigabit Ethernet
-   * deeper-sdv[09,10]: 1 x Arria 10 FPGA PAC
+   * 1 NVMe with 400 GB per node
 
- * KNLs [4 nodes]: `knl[01,04-06]`
-   * 1 Intel Xeon Phi (64-68 cores)
-   * 1 NVMe with 400 GB per node (accessible through BeeGFS on demand)
-   * 16 GB MCDRAM plus 96 GB RAM per KNL
-   * network: 1 Gigabit Ethernet
+ * Intel MAX [2 nodes]: `dp-intelmax[01,01]`
+   * 2 x Intel(R) Xeon(R) CPU Max 9462 (2.7 GHz, 32 cores per socket)
+   * 1 TB RAM + 138 GB HBM
+   * 1 NVMe with 1 GB per node 
+   * network: EDR Infiniband 100 Gb/s
 
  * GPU nodes for Machine Learning [3 nodes]: `ml-gpu[01-03]`