Convergence Analysis of Hierarchical Split Federated Learning
Hualei Zhang, Jun Du, Xiangwang Hou, Chunxiao Jiang, Jintao Wang, Dusit Tao Niyato · 2024
Federated Learning (FL) enables distributed intelligence in Internet of Things (IoT) networks, facilitating decentralized machine learning without the need for exchanging raw data. However, the growing complexity of training models significantly hinders their deployment on resource-constrained IoT devices. To address this challenge, Split Federated Learning (SFL) has emerged as a promising solution by partitioning the entire model into client-side and server-side sub-models to alleviate the computational burden on IoT devices. Considering that the client-edge-cloud architecture can enhance data privacy, support connections to a wider range of devices, and reduce communication costs, we explore a hierarchical SFL (HierSFL) system. This system is supported by a HierSFL algorithm that allows for different aggregation frequencies between the client-side and server-side sub-models. Then, we present a convergence analysis of HierSFL that quantifies the effects of client-side and server-side model aggregation on learning performance, providing a theoretical foundation. Empirical experiments verify the theoretical analysis and demonstrate the superiority of the hierarchical architecture within a wireless IoT network. In particular, it is validated that adopting different aggregation frequencies can enhance the training performance. Moreover, the HierSFL algorithm outperforms traditional hierarchical FL algorithm, achieving superior test accuracy in a shorter time.