Multilevel Approach to HPC Center Workload and User Applications Efficiency Analysis
Dmitry A. Nikitenko, Vadim Voevodin · 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON) · 2019
Every HPC Center holder wants his systems to be productive, and every supercomputer user tries to achieve his research goals as fast as possible, thus wanting his jobs to run efficiently. There are lots of possible approaches for solving such problems. This paper shares the experience of tackling these challenges at the supercomputer center of Moscow State University, the largest HPC center in Russia, hosting Lomonosov-2 system with 4.95 PFlops of peak performance and some smaller systems aimed at providing computing services for hundreds of research projects, running about one thousand jobs per day. The proposed approach covers various levels of role-specific analysis scenarios, from the overall resource utilization and job state distribution down to the precise efficiency analysis of particular jobs including detection of possible performance issues. This approach is being implemented using modules for the Octoshell HPC center management system and used by system administrators and regular users in their daily practice.