A Load-Balanced Deterministic Runtime for Pipeline Parallelism
Chen Chen, Kai Lü, Xiaoping Wang, Xu Zhou, Zhendong Wu · IEICE Transactions on Information and Systems · 2015
Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.