Job resource prediction and completion status prediction on large-scale computing platforms
Jiale He, Tao Zhang, Yu Zheng · 2024
Predicting the resource consumption and completion status of jobs is beneficial to improve the scheduling performance of the system. Many studies have shown that job name can effectively improve the accuracy of prediction. Therefore, by mining the structural semantic information of job name, this paper introduces new features of job name habit, including job name length, number of job name elements, editing distance, and analyzes each substructure of job name, adding classification features after clustering. The introduced new features can better characterize the similarity between jobs and provide strong support for model prediction. Based on the model trained by the new feature data set, the prediction accuracy is significantly improved compared with the model that only introduces the job name.