Split Aggregation: Lightweight Privacy-Preserving Federated Learning Resistant to Byzantine Attacks
Zhi Gang Lu, Songfeng Lu, Yongquan Cui, Xueming Tang, Junjun Wu · IEEE Transactions on Information Forensics and Security · 2024
Federated Learning (FL), a distributed learning paradigm optimizing communication costs and enhancing privacy by uploading gradients instead of raw data, now confronts security challenges. It is particularly vulnerable to Byzantine poisoning attacks and potential privacy breaches via inference attacks. While homomorphic encryption and secure multi-party computation have been employed to design robust FL mechanisms, these predominantly rely on Euclidean distance or median-based metrics and often fall short in comprehensively defending against advanced poisoning attacks, such as adaptive attacks. Addressing this issue, our study introduces “Split-Aggregation", a lightweight privacy-preserving FL solution capable of withstanding adaptive attacks. This method maintains a computational complexity ofO(dkN+k3) and a communication overhead ofO(dN), performing comparably to FedAvg whenk= 10. Here,drepresents the gradient dimension,Nthe number of users, andkthe rank chosen during random singular value decomposition. Additionally, we utilize adaptive weight coefficients to mitigate gradient descent issues in honest users caused by non-independent and identically distributed (Non-IID) data. The proposed method’s security and robustness are theoretically proven, with its complexity thoroughly analyzed. Experimental results demonstrate that atk= 10, this method surpasses the top-1 accuracy of current state-of-the-art robust privacy-preserving FL approaches. Moreover, opting for a smallerksignificantly boosts efficiency with only marginal compromises in accuracy.