AddShare+: Efficient Selective Additive Secret Sharing Approach for Private Federated Learning
Bernard Atiemo Asare, Paula Branco, Iluju Kiringa, Tet Hin Yeap · 2024
Federated Learning (FL) enables collaborative training of Machine Learning (ML) models while maintaining user data privacy. However, leaked model updates can reveal private training data. Existing solutions using additive secret sharing introduce intermediary servers, increasing complexity and communication overhead, and often lack privacy guarantees. We propose AddShare+, which enhances efficiency and scalability by creating additive shares for a subset of model weight parameters and using the Elliptic Curve Integrated Encryption Scheme (ECIES) for faster, lighter model encryption. By sampling and splitting a percentage of local weight parameters, AddShare+ reduces computation and communication costs while maintaining model accuracy. We implemented and evaluated AddShare+ on multiple datasets, comparing it with baseline approaches including FedAvg, SCOTCH, FedShare, and AddShare. Results demonstrate that AddShare+ maintains accuracy while significantly reducing running time per round. Notably, sharing as low as 25% of model weights decreases bandwidth demands by over 5x while preserving accuracy within 0.05 % of the full model. Our empirical results demonstrate significant reductions in running time per round with strong privacy guarantees, highlighting the potential of lightweight partial sharing solutions for privacy-preserving FL in resource-constrained environments, paving the way for more efficient and secure collaborative learning systems.