Improving backfilling by using machine learning to predict running times

Éric Gaussier, David Glesser, Valentin Reis, Denis Trystram · 2015

The job management system is the HPC middleware responsible for distributing computing power to applications. While such systems generate an ever increasing amount of data, they are characterized by uncertainties on some parameters like the job running times. The question raised in this work is: To what extent is it possible/useful to take into account predictions on the job running times for improving the global scheduling?

Read the paper · More papers on PaperTik