Toward Full Cluster Resource Utilization
N. Bienati, L. Bortot, J. Panizzardi · 2022
Summary With real world HPC applications, it is unlikely that all the resources of a cluster node can be fully used simultaneously by a single application. However, if a single application completely exhausts one of the node’s resources, it might prevent the possibility for other applications to exploit the remaining resources, which are likely to remain partially unused. Moreover, since most of the seismic imaging algorithms are embarrassingly parallel, in the context of a seismic imaging multi-user and multi-project scenario the challenge is often to efficiently execute a very large number of asynchronous and loosely coupled tasks. This combines with the nature of modern full wave imaging and velocity analysis, which results in variability of memory requirement and computing unit occupancy, that can both span several orders of magnitude. In this presentation we will discuss what are the recommendable actions that can be taken to maximize cluster resource utilization whenever the majority of the workload has these characteristics.