Overlap Communication in MPI Implementations
Thananon Patinyasakdikul, George Bosilca, Jack J. Dongarra · 2014
High performance computing has been a very big trend for the past decade. We are in the age that can not just rely on speedup from silicon alone anymore. Computer scientists have been implementing ways to improve the performance of application by making use of the increased of CPU core. One of those technique is “Message Passing Interface (MPI)”, which has a long history back to 1980. MPI standard has been improved since then. Many organizations developed their own implementation of MPI under MPI standard to serve as a tool to achieve higher performance. In this paper, we focus on the basic part of MPI which is point to point communication. We benchmark famous MPI implementations and implement overlap communication for Open MPI. We demonstrate the process, the problem we encountered and the result of our implementation.