Accelerating Heterogeneous Coupling Computing with WaitIO Using RDMA
Shinji Sumimoto, Takashi Arakawa, Yoshio Sakaguchi, Hiroya Matsuba, Satoshi Ohshima, Hisashi Yashiro, Toshihiro Hanawa, Kengo Nakajima · 2025
In this paper, we propose communication libraries WaitIO-Verbs and WaitIO-Tofu using RDMA communication to speed up communication performance in the h3-OpenSYS/WaitIO (WaitIO) library, which can connect multiple MPI programs across multiple heterogeneous systems.It is important to use industry-standard communication methods for communication between heterogeneous systems, and WaitIO implements WaitIO-Socket and WaitIO-File, which use POSIX-based specifications for socket and file IO.However, since POSIX specifications generally use system calls, there is a possibility that sufficient performance may not be obtained depending on the system.Therefore, to further speed up communication, we implemented WaitIO-Verbs and WaitIO-Tofu using user-level RDMA using industry-standard or default system communication specifications.As a result of implementation and evaluation, we achieved high communication performance and application performance.WaitIO achieved high application performance even between multiple heterogeneous clusters, which MPI could not achieve.