Fault-Tolerant Scheduling of Fine-Grained Tasks in Grid Environments
Gosia Wrzesiñska, Rob V. van Nieuwpoort, Jason Maassen, Thilo Kielmann, Henri E. Bal · The International Journal of High Performance Computing Applications · 2006
Divide-and-conquer is a well-suited programming paradigm for parallel Grid applications. Our Satin system efficiently schedules the fine-grained tasks of a divide-andconquer application across multiple clusters in a grid. To accommodate long-running applications, we present a fault-tolerance mechanism for Satin that has negligible overhead during normal execution, while minimizing the amount of redundant work done after a crash of one or more nodes. We study the impact of our fault-tolerance mechanism on application efficiency, both on the Dutch DAS-2 system and using the European testbed of the ECfunded project GridLab.