Verifying Performance Guidelines for MPI Collectives at Scale
Sascha Hunold · 2023
MPI collective communication operations are crucial for high-performance computing, making the efficient implementation of collective algorithms essential for optimal application performance. While most MPI libraries provide several algorithms for a specific collective operation, each may work better in a specific scenario. Therefore, selecting the most suitable algorithm for each use case is important. However, even the best algorithm in a given MPI library’s set may deliver suboptimal performance.