Efficient alltoall_inplace communication algorithms with limited buffer space
Yanfei Fang, Yanbing Li, Enming Dong, Fengbin Qi, Wangquan He, Yunfei Wang, Zhengmao Xu · 2023
Alltoall is an important collective communication mode that is widely used in scientific and engineering computing applications. In applications such as FFT, using as much memory space as possible can improve applications’ efficiency and expand the scale of problems to be solved. High-bandwidth alltoall_inplace communication under space-constrained buffer conditions can significantly improve the performance of such applications. In this paper, two alltoall_inpalce communication algorithms under the condition of limited buffer space are designed for the domestic parallel computing system based on Sunway many-core processor. The alltoall_inpalce communication interfaces for both the core array and the whole CPU node are realized. The experimental results show that algorithms implemented in this paper can achieve high bandwidth using limited buffer space.