Network Performance Aware MPI Collective Communication Operations in the Cloud
Yifan Gong, Bingsheng He, Jianlong Zhong · IEEE Transactions on Parallel and Distributed Systems · 2013
This paper examines the performance of collective communication operations in message passing interfaces (MPI) in the cloud computing environment. The awareness of network topology has been a key factor in performance optimizations for existing MPI implementations. However, virtualization in the cloud environment not only hides the network topology information from the users, but also causes traffic interference and dynamics to network performance. Existing topology-aware optimizations are no longer feasible in the cloud environment. Therefore, we develop novel network performance aware algorithms for a series of collective communication operations including broadcast, reduce, gather and scatter. We further implement two common applications, N-body and conjugate gradient (CG). We have conducted our experiments with two complementary methods (on Amazon EC2 and simulations). Our experimental results show that the network performance awareness results in 25.4 and 28.3 percent performance improvement over MPICH2 on Amazon EC2 and on simulations, respectively. Evaluations on N-body and CG show 41.6 and 14.3 percent respectively on application performance improvement.