Changes between Version 5 and Version 6 of Public/User_Guide/SIONlib
- Timestamp:
- Dec 3, 2019, 9:35:44 AM (4 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Public/User_Guide/SIONlib
v5 v6 5 5 == Modules == 6 6 7 Recent versions of SIONlib are available on the DEEP-EST SDVthrough the new software stack as modules:7 Recent versions of SIONlib are available on the DEEP-EST prototype through the new software stack as modules: 8 8 9 9 {{{ 10 $ module load Intel ParaStationMPI SIONlib10 $ module spider SIONlib/1.7.6 11 11 }}} 12 12 … … 22 22 The mechanism has been extended with a new MSA-aware algorithm for the selection of collector processes. 23 23 The algorithm is portable and relies on platform specific plug-ins to identify processes which run on parts of the system that are well suited for the role of I/O collector. 24 So far, a specific plug-in for the DEEP-EST SDV has been implemented as well as a test plug-in. 24 So far, three plug-ins have been implemented: 25 - a new generic plug-in -- `hostname-regex` -- which selects collectors tasks by matching the host name of the node they are running on against regular expressions that can be defined via environment variables, 26 - an older plug-in -- `deep-est-std` -- that selects collector tasks using a similar mechanism, but with host names hard-coded to match cluster nodes of an earlier version of the DEEP-EST prototype, 27 - a mock-up plug-in for testing purposes. 25 28 In the future, further plug-ins for new systems of the MSA type can be added. 26 29 … … 28 31 29 32 {{{#!sh 30 ./configure --msa= deep-est-sdv# ... more configure arguments33 ./configure --msa=hostname-regex # ... more configure arguments 31 34 }}} 32 35 … … 38 41 {{{#!c 39 42 sion_paropen_mpi("filename", "...,collmsa,...", ...); 43 }}} 44 45 Also, when the new `hostname-regex` collector selection plug-in is enabled, an environment variable `SION_MSA_COLLECTOR_HOSTNAME_REGEX` has to be defined to contain a POSIX basic regular expression to match against hostnames of nodes running candidates for the collector role (`SION_MSA_COLLECTOR_HOSTNAME_EREGEX` can be used alternatively, but should contain a POSIX extended regular expression). 46 For example, to select nodes from the DAM as collectors, set: 47 48 {{{#!sh 49 export SION_MSA_COLLECTOR_HOSTNAME_EREGEX="dp-dam.*" 40 50 }}} 41 51