HPC Performance on AWS: EFA Integrated Intel Instances for MPI Applications
Mandeep Kumar, Gagandeep Kaur, Prashant Singh Rana · 2024
High Performance Computing (HPC) has become an indispensable tool in various scientific and engineering domains, demanding efficient infrastructure to support computationally intensive tasks. Cloud computing platforms, such as Amazon Web Services (AWS), have emerged as a viable solution for provisioning HPC resources. In this work, we explore the performance of HPC workloads running on AWS, utilizing Elastic Fabric Adapter (EFA) interconnect technology and Intel Xeon Scalable Processors. The investigation focuses on Message Passing Interface (MPI) applications, evaluating the system's efficiency, scalability, and the benefits of EFA integration. We present experimental results and insights into optimizing HPC workloads in the AWS environment, contributing to the ongoing discussion on achieving high-performance computational capabilities in the cloud.