Improving Preemptive Scheduling with Application-Transparent Checkpointing in Shared Clusters
Jack Li, Calton Pu, Yuan Chen, Vanish Talwar, Dejan S. Milojicic · 2015
Modern data center clusters are shifting from dedicated single framework clusters to shared clusters. In such shared environments, cluster schedulers typically utilize preemption by simply killing jobs in order to achieve resource priority and fairness during peak utilization. This can cause significant resource waste and delay job response time.