A self‐adjusting task granularity mechanism for the Java lifeline‐based global load balancer library on many‐core clusters
Patrick C. Finnerty, Tomio Kamada, Chikara Ohta · Concurrency and Computation Practice and Experience · 2021
Summary Global load balancer libraries should be easy to use and allow users to easily obtain good performance for their applications on a variety of distributed systems. In this article, we introduce a new tuning mechanism to our Java implementation of the lifeline‐based global load balancer which automatically adjusts the task granularity to reach good performance based on some selected runtime metrics. We evaluate our system against four backtrack‐search problems on both a many‐core supercomputer environment and on a beowulf server, achieving ideal performance with our tuning mechanism on the supercomputer. We also identify the limits of our mechanism in handling situations with reduced imbalance.