Client Selection With Staleness Compensation in Asynchronous Federated Learning
Hongbin Zhu, Junqian Kuang, Miao Yang, Hua Lin Qian · IEEE Transactions on Vehicular Technology · 2023
As a nascent privacy-preserving machine learning (ML) paradigm, federated learning (FL) leverages distributed clients at the network edge to collaboratively train an ML model. Asynchronous FL overcomes the straggler issue in synchronous FL. However, asynchronous FL incurs thestalenessproblem, which degrades the training performance of FL over wireless networks. To tackle thestalenessproblem, we develop astalenesscompensation algorithm to improve the training performance of FL in terms of convergence and test accuracy. By including the first-order term in Taylor expansion of the gradient function, the proposed algorithm compensates thestalenessin asynchronous FL. To further minimize training latency, we model the client selection for asynchronous FL as a multi-armed bandit problem. We develop an online client selection algorithm to minimize training latency without prior knowledge of the channel condition or local computing status. Simulation results show that the proposed algorithm outperforms the baseline algorithms in both test accuracy and training latency.