PGAS communication runtime for extreme large data computation
Ryo Matsumiya, Toshio Endo · 2016
For partitioned global address space (PGAS) runtimes, supporting out-of-core data computation is an important issue. Some researchers showed that flash SSDs are useful for out-of-core data computation.In this paper, we introduce ComEx-PM, a PGAS communication runtime. ComEx-PM supports out-of-core data computation using a flash SSD. ComEx-PM launched multiple processes in each node. Memory region of each process is swapped into a flash SSD if total size of the data is out-of-core.We adopted ComEx-PM into Global Arrays (GA), a PGAS runtime library. We executed two programs developed with GA. One program is a dense matrix-matrix multiplication (dgemm) program. The other program is a simple 2D stencil computation program. The dgemm program showed ComEx-PM could run the program with the same performance as the original GA. The stencil program illustrated the overhead of ComEx-PM and how to reduce it.