Research and implementation of MPI+CUDA model based on SMP clusters
Qingkui Chen · Jisuanji gongcheng yu sheji · 2010
In order to study the general computing ability of GPU and programming model suitable for SMP clusters,a method of MPI+ CUDA multi-grain hybrid parallel programming is proposed,which implemented the coarse grain parallel programming between the nodes and the fine grain parallel programming in the node using MPI and CUDA respectively.A SMP clusters environment is built with 3 computers,and the large-scale matrix multiplication with multi-grain hybrid parallel programming is achieved.It is indicated that MPI+ CUDA hybrid parallel programming is an effective parallel strategy for the parallel computing in the SMP clusters with CUDA-enabled GPU,which exerts the advantages of the share memory in the node and the distributional memory between the nodes in the SMP clusters.This method promote parallel efficiency remarkably.