D-Rex: Heterogeneity-Aware Reliability Framework and Adaptive Algorithms for Distributed Storage
Maxime Gonthier, Dante Domizzi Sánchez-Gallegos, Haochen Pan, Bogdan Nicolae, Sicheng Zhou, Hai Thanh Nguyen, Valérie Hayot‐Sasson, J. Gregory Pauloski, Jesús Carretero, Kyle Chard, Ian T Foster · 2025
The exponential growth of data necessitates distributed storage models, such as peer-to-peer systems and data federations.While distributed storage can reduce costs and increase reliability, the heterogeneity in storage capacity, I/O performance, and failure rates of storage resources makes their efficient use a challenge.Further, node failures are common and can lead to data unavailability and even data loss.