Desynchronized Communication Schemes on Distributed-Memory Architectures
J-Y. Blanc, Denis Trystram, Gilles Villard · 2005
In this paper, we present the theoretical analysis and the implementation of fundamental communication routines for broadcasting data on hypercube distributed-memory computers. We introduce new desynchronized strategies, where computations and communications are mixed. Experiments are given on a real-life machine. This analysis shows that the load-balanced data repartition is the best among all the strategies when the problem is large, however, for practical experiments with problems limited by the memory capacity, the desynchronized method that we propose in this paper is faster than the well-known synchronized broadcasts for practical problems.