FedWNS: Data Distribution-Wise Node Selection in Federated Learning via Reinforcement Learning
Chengwu Tu, Shengjie Zhao, Hao Deng · 2023
To deal with the discrepancy between global and local objectives in the federated learning invoked by the non-independent, identically distributed (non-IID) data and mitigate the impact of catastrophic forgetting in the training phase, we propose a federated learning framework with data distribution-wise reinforcement learning to perform node selection to accelerate the convergence process and alleviate the accuracy degradation. In this framework, the agent on the central server observes the number of samples every node owns, the derived distribution information of every dataset, and the current local and global accuracy. Then infer the selected node-set to participate in the current federated learning round through policy network in reinforcement learning. Finally, we conduct simulations with publicly data sets. Simulation results indicate that our FedWNS outperforms the existing FedAvg and CSFedAvg on the testing accuracy and the communication rounds to reach target accuracy under different settings.