Optimal Checkpointing Strategies for Iterative Applications
Yishu Du, Loris Marchal, Guillaume Pallez, Yves Robert · IEEE Transactions on Parallel and Distributed Systems · 2021
This work provides an optimal checkpointing strategy to protect iterative applications from fail-stop errors. We consider a general framework, where the application repeats the same execution pattern by executing consecutive iterations, and where each iteration is composed of several tasks. These tasks have different execution lengths and different checkpoint costs. Assume that there arentasks and that task ai, where 0 ≤ in, has execution time tiand checkpoint cost ci. A naive strategy would checkpoint after each task. Another naive strategy would checkpoint at the end of each iteration. A strategy inspired by the Young/Daly formula would work for √{2 μcave} seconds, where μ is the application MTBF and caveis the average checkpoint time, and checkpoint at the end of the current task (and repeat). Another strategy, also inspired by the Young/Daly formula, would select the task aminwith smallest checkpoint cost cminand would checkpoint after every pthinstance of that task, leading to a checkpointing period p T, where T = Σi=0n-1aiis the time per iteration. One would choose the period so that p T ≈ √{2 μcmin} to obey the Young/Daly formula. All these naive and Young/Daly strategies are suboptimal. Our main contribution is to show that the optimal checkpoint strategy is globally periodic, and to design a dynamic programming algorithm that computes the optimal checkpointing pattern. This pattern may well checkpoint many different tasks, and this across many different iterations. We show through simulations, both from synthetic and real-life application scenarios, that the optimal strategy outperforms the naive and Young/Daly strategies.