Implémentation d'un ordonnancement déséquilibré d'E/S dans un système de fichiers parallèle
Clément Barthélemy, Francieli Zanon Boito, Emmanuel Jeannot, Guillaume Pallez, Luan Teylo · HAL (Le Centre pour la Communication Scientifique Directe) · 2024
In this report, we discuss a BeeGFS-based implementation of the IO-Sets method for I/O scheduling in HPC systems. I/O scheduling is a technique to mitigate contention in the access to the shared parallel file system. Despite its popularity in the literature, most proposed I/O scheduling techniques are not used in practice due to the difficulty of obtaining the needed information and due to overhead concerns. Compared to other techniques, IO-Sets uses little information on the applications, which makes it attractive to be used in practice. In this context, we chose to implement it inside the parallel file system to make it transparent to applications,and without a centralized control. That means relaxing the method, but mitigates its limitations regarding overhead and fault tolerance. We discuss the implementation in details and present preliminary results.