Two-Level Scheduling Technology For Heterogeneous Clusters Using Analytical Hierarchy Processes
Tianhai Zhao, Jianhua Gu, Xiaoyuan Zhang · 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS) · 2021
The cluster system presents multi-level and complex heterogeneous features with GPUs computing. Job scheduling technology determines computing resource utilization and throughput of the cluster system. On the basis of heterogeneous cluster system, the two-level scheduling technology is proposed in this paper. In the first level, a job priority scheduling algorithm based on user value is designed at the cluster level using analytical hierarchy processes. The second level of scheduling is to act on the computing nodes that contain GPUs, and design a scheduling algorithm based on GPU sharing policy that manages GPU jobs in a more fine-grained manner. Through experiments, it shows that the job priority scheduling algorithm based on user value can ensure that jobs with high user value are executed first, and fairness is guaranteed. The scheduling algorithm based on GPU sharing technology can significantly improve the utilization of GPU and video memory, reducing the average waiting time of jobs by 55.54% and the average turnaround time of jobs by 28.83%.