Poster: Towards Accurate and Fast Federated Learning in End-Edge-Cloud Orchestrated Networks
Mingze Li, Peng Sun, Huan Zhou, Liang Zhao, Xuxun Liu, Victor C. M. Leung · 2023
This work proposes a novel three-layer federated learning (FL) framework with parameter selection and pre-synchronization (PSPFL) to achieve fast and accurate model training. The basic idea of PSPFL is that clients select partial model parameters for transmission and then base stations aggregate them cooperatively (i.e., pre-synchronization) and send the aggregated results to the server for global model update periodically. However, there is an intrinsic trade-off between parameter transmission overhead and model training loss. To strike a desirable balance between them, we investigate the optimal parameter pre-synchronization round and local training round under PSPFL. Specifically, we propose a Deep Q-Network (DQN)-based method to obtain the local training round and parameter pre-synchronization round. Finally, extensive experiments are conducted to evaluate the performance of the proposed method on commonly used datasets. The results show that the proposed method can reduce the sum of FL completion time and training loss by an average of 8.17%-18.82% compared to benchmarks.