MCM: A new MPI Communication Management for Cloud Environments
Laura Espínola, Daniel Franco, Emilio Luque · Procedia Computer Science · 2017
On-demand Cloud Computing offers an attractive new dimension to High Performance Computing (HPC). Many HPC applications are moving to clouds due to some characteristics of this environment, like elasticity, pay per use, and the maintenance cost. HPC applications normally use Message Passing Interface (MPI). However, for this kind of applications on cloud environments, network performance remains a challenge due to the effects of network virtualization. To use a cloud environment with scientific applications of this kind, low latency communication mechanisms are required, and the hidden network topology information makes difficult to use the existing optimizations based on network topology information. In this paper a method named MPI Communication Management (MCM) is presented. This method characterizes the underlying network topology and analyzes parallel applications behavior in the cloud, improving the application’s messages latency time. MCM achieves lower application execution time in case of congestion, obtaining better performance in clouds. Finally, experiments verify the functionality and improvements of MCM with MPI Applications in Amazon EC2 public cloud.