Dynamic and Adaptive Monitoring and Analysis for Many-task Ensemble Computing
Shantenu Jha, Allen D. Malony · 2021
Applications are not what they used to be. Modern HPC applications are increasingly a mix of heterogeneous tasks and services – both internal and external. This imposes new constraints and requirements on application and performance monitoring, which is fundamentally different from single-task monitoring. Runtime decisions are needed, and critically rely on monitored information to determine what to do. Thus, online monitoring and analytics must be first-class requirements of all applications and the runtime environments that support their execution. This position paper explores the implications of novel application requirements on future monitoring and profiling subsystems, in the context of ensemble computing.