ClassTer: Mobile Shift-Robust Personalized Federated Learning via Class-Wise Clustering
Xiaochen Li, Sicong Liu, Zimu Zhou, Xu Yuan, Bin Guo, Zhiwen Yu · IEEE Transactions on Mobile Computing · 2024
The rise of mobile devices with abundant sensor data and computing power has driven the trend of federated learning (FL) on them. Personalized FL (PFL) aims to train tailored models for each device, addressing data heterogeneity from diverse user behaviors and preferences. However, due to dynamic mobile environments, PFL faces challenges intest-time data shifts, i.e., variations between training and testing. While this issue is well studied in generic deep learning through model generalization or adaptation, this issue remains less explored in PFL, where models often overfit local data. To address this, we introduce${\sf ClassTer}$, a shift-robust PFL framework. We observe that class-wise clustering of clients in cluster-based PFL (CFL) can avoid class-specific biases by decoupling the training of classes. Thus, we propose a paradigm shift from traditional client-wise clustering toclass-wise clustering, which allowseffective aggregationof cluster models into a generalized one via knowledge distillation. Additionally, we extend ClassTer toasynchronousmobile clients to optimize wall clock time by leveraging critical learning periods and both intra- and inter-device scheduling. Experiments show that compared to status quo approaches,${\sf ClassTer}$achieves a reduction of up to 91% in convergence time, and an improvement of up to 50.45% in accuracy.