Draft & Refine: Efficient Resource Management in Federated Learning under Pathological Labels Skew
Erich Malan, Valentino Peluso, Andrea Calimera, Enrico Macii · 2024
In Federated Learning (FL), network end-nodes use private data for the local training of classification models that are periodically synchronized with a remote server to update a global model. A key limitation in FL is the high network traffic required to achieve acceptable accuracy, particularly when each client has samples of only a few classes, a problem known as pathological labels skew. Under such constraints, local models become biased toward the available classes, and more synchronization rounds are needed to converge, saturating the communication budget. We address this issue with Draft & Refine, a new resource management strategy to optimize accuracy by dynamically controlling clients' participation based on their remaining budget. Our approach consists of two learning phases: a low-effort drafting phase with only a few clients selected for synchronization, followed by a refinement phase with increased client participation. The available data traffic is used as the control variable to set the duration of the two phases. The proposed strategy outperforms state-of-the-art FL schemes with up to 12.20 % higher accuracy within the same data traffic.