Optimizing HPL Benchmark on Multi-GPU Clusters
Zhiying Wang · 2013
The current high performance Linpack benchmark accelerated by GPU usually employs the performance-based dynamic load balancing algorism.However,this algorism does not perform well on multi-GPU cluster.The reason is that each GPU on this kind of node has a smaller calculating scale,and the gap of the total performance between GPU and CPU is larger.Therefore,this article proposed an experience-based dynamic load balancing algorism and a multi-GPU adaptive load balance algorithm.Besides,the article tested these two algorisms on multi-GPU cluster and it achieves a 6.3% acceleration compared with the latest NVIDIA's HPL accelerated by GPU.