Changes between Version 20 and Version 21 of Public/User_Guide/DEEP-EST_DAM
- Timestamp:
- Jul 14, 2022, 11:21:19 AM (23 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Public/User_Guide/DEEP-EST_DAM
v20 v21 44 44 * `dp-dam[09-12]`: 2 x Nvidia V100 45 45 46 Please use the `gres` option with `srun` if you would like to run Cuda programs, e.g. in an interactive session:46 Please use the `gres` option with `srun` if you would like to use GPUs on DAM nodes, e.g. in an interactive session: 47 47 48 48 {{{ … … 52 52 53 53 To compile and run Cuda applications on the Nvidia V100 cards included in the DAM nodes, it is necessary to load the CUDA module. It's advised to use the 2022 Stage to avoid 54 [https://deeptrac.zam.kfa-juelich.de:8443/trac/wiki/Public/User_Guide/PaS#Softwareissues Nvidia driver mis smatch] issues.54 [https://deeptrac.zam.kfa-juelich.de:8443/trac/wiki/Public/User_Guide/PaS#Softwareissues Nvidia driver mismatch] issues. 55 55 {{{ 56 56 module --force purge … … 72 72 == Using FPGAs == 73 73 74 Each node is equipped with a Stratix 10 FPGA. For getting started using OpenCL with the FPGAs you can find some hints as well as the slides and exercises from the Intel FPGA workshop held at JSC in: 74 Nodes `dp-dam[13-16] are equipped with 2 x Stratix 10 FPGAs each 75 ([https://www.intel.de/content/www/de/de/products/sku/193921/intel-fpga-pac-d5005/specifications.html Intel PAC d5005]). 76 77 78 It is recommended to do the first steps in an interactive session on a DAM node. 79 Since there is (currently) no FPGA resource defined in SLURM for these nodes, please use the `--hostlist=` option with `srun` to open a session on a DAM node equipped with FPGAs, for example: 75 80 76 81 {{{ 77 /usr/local/fpga 82 srun -A deepsea -p dp-dam --nodelist=dp-dam13 -t 1:0:0 --interactive --pty /bin/bash 78 83 }}} 79 84 80 It is recommended to do the first steps in an interactive session on a DAM node. To set up and check the FPGA environment, do the following:85 For getting started using OpenCL with the FPGAs you can find some hints as well as the slides and exercises from the Intel FPGA workshop held at JSC in: 81 86 82 87 {{{ 83 source /usr/local/fpga/FPGA_init.sh 88 /usr/local/software/legacy/fpga/ 89 }}} 90 91 More details to follow. 92 93 {{{#!comment currently not working 94 To set up and check the FPGA environment, do the following: 95 96 {{{ 97 /usr/local/software/legacy/intel/oneapi/setvars.sh 84 98 lspci | grep -i 'accel' 85 99 aocl list-devices … … 103 117 In addition, you will have to adapt the OpenCL host file to select the correct platform ("Intel(R) FPGA SDK for OpenCL(TM)" or "Intel(R) FPGA Emulation Platform for OpenCL(TM) (preview)"). 104 118 119 105 120 **Attention:** Compiling kernels for the FPGA device (instead of the emulator) might take several hours. 106 121 … … 112 127 https://gitlab.version.fz-juelich.de/DEEP-EST/fpga_usage 113 128 114 129 end of comment }}} 115 130 116 131 == Filesystems and local storage ==