Analysis of All-to-all Collective Operations on Hierarchical Computer Clusters
Eugene N. Peryshkova, Mikhail G. Kurnosov · 2020 International Multi-Conference on Industrial Engineering and Modern Technologies (FarEastCon) · 2020
In this paper, we consider implementation algorithms of broadcast-cyclic exchanges, also called All-to-all. The choice of the total exchange patterns is due to its widespread using collective communication in supercomputer simulation packages. Authors have developed a software for predicting the execution time of the All-to-all operation on the given subsystem of nodes. A software uses the results of an experimental estimate of the performance degradation for the MPI_Send/MPI_Recv operations during simultaneous use of the communication channel by a set of processes. We analyze the dependence of the All-to-all patterns passing time on the size messages when MPI- processes share the communication channels. Authors have developed recommendations about All-to-all operation implementation algorithms.