EuroCC@GCS and EuroCC-Austria, the German and Austrian National Competence Centres for High-Performance Computing (HPC), jointly organize a course on Hybrid Programming in HPC - MPI+X from 23 to 25 January 2024. The registration deadline is 26 December 2023.
Clusters of shared memory nodes are the foundation of most HPC systems. To take full advantage of these systems, it is important to optimize both memory consumption and communication time. Hybrid programming is a great solution for this, as it combines distributed memory parallelization on the node interconnect, such as with MPI, with shared memory parallelization inside of each node, for example, with OpenMP or MPI-3.0 shared memory. This course analyzes the strengths and weaknesses of several parallel programming models on clusters of SMP (Symmetric Multi-Processing) nodes.
Hands-on sessions are included every day. Tools for hybrid programming, such as support for thread/process placement and performance analysis, are presented in a how-to section.