FedGAC: Graph Federated Learning with Gradients Aggregation Calibration for Non-IID and Long-Tailed Data
Jie Li, Jinyan Wang, Rongbin Deng, Dongqi Yan, Qiyu Li · 2024
Federated graph learning (FGL) combines the advantages of graph neural networks and federated learning, extracting valuable information from decentralized graph data while preserving data privacy. Existing FGL methods typically consider mitigating the effect of non-IID under the class balanced assumption. However, in many real-world scenarios, the data class distribution often exhibits a long-tailed distribution, which can lead to the model being severely biased towards the head classes, thus affecting the overall performance of the global model. To address the challenges posed by non-IID and long-tailed distribution data in FGL, this paper proposes a method called FedGAC to train a globally balanced model. In the local stage, FedGAC employs feature-structure decoupled graph attention network to train client models, introduces class-importance balanced strategy to mitigate class imbalance issues, and leverages knowledge relearning strategy to enhance model generalization. In the global stage, FedGAC employs an adaptive gradients aggregation strategy that dynamically adjusts balancing factors based on the degree of class imbalance in each client’s data, thereby optimizing the aggregation process. Additionally, it utilizes global class gradients to calibrate learnable features. Experimental results demonstrate that, compared to the state-of-the-art federated learning methods, FedGAC achieves superior performance on highly non-IID and long-tailed distribution datasets.