Performance Improvement of Asynchronous Iterations by Non-Uniform Load Distribution.
Jarek Nieplocha, Tsun‐Zee Mai · PPSC · 1995
Asynchronous iterative methods may be employed to solve large and sparse systems of linear equations that arise in the numerical solution of partial differential equations by using finite difference methods. Asynchronous iterations have been studied in hope that they would offer better ways for dealing with the high communication latency on the massively parallel systems. Comparing to their synchronous counterparts, asynchronous iterations may be indeed implemented more efficiently due to the lack of synchronization; however, their convergence rate could be worse than expected. This paper presents a nontraditional approach to load balancing as a way to improve performance of asynchronous iterations.