What does Inter-Cluster Job Submission and Execution Behavior Reveal to Us?
Tirthak Patel, Devesh Tiwari, Raj Kettimuthu, William E. Allcock, Paul Rich, Zhengchun Liu · 2022
Modern High Performing Computing (HPC) facil-ities have multiple computing clusters that serve different pur-poses. These include large-scale computing clusters and smaller data visualization and analysis clusters, which are meant to shift the load of data analytics jobs from the large-scale systems. We perform the first in-depth characterization of cross-cluster behavior of users and jobs and provide an analysis of three inter-related systems at the Argonne Leadership Computing Facility (ALCF). Our analysis reveals interesting trends related to the resource utilization and predictability of user and job behavior across different clusters.