A Practical Method to Implement Asynchronous Iterative Algorithms on MPI and a Case Study for Asynchronous Self-Organizing Maps.
Jie Hu, Bishow Mohan Paudel · 2008
In this paper, an effective implementation scheme for asynchronous parallel iterative algorithms on messagepassing systems using MPI non-blocking communication model is proposed. The main idea of the method is to use a MPI_IPROBE function to check for the existence of pending messages without receiving them, thereby allowing us to write programs that interleave local computation with the processing of incoming messages. The communication overhead is further reduced by persistent communication, which is an optimization for point to point message passing. As a case study, we applied the proposed scheme to implement the asynchronous Self-organizing Maps proposed in [8] and analyzed the efficiency of the algorithm. 1.