Differentially Private Federated Temporal Difference Learning
Yiming Zeng, Yixuan Lin, Yuanyuan Yang, Ji yin Liu · IEEE Transactions on Parallel and Distributed Systems · 2021
This paper considers a federated temporal difference() (TD()) learning algorithm and provides both asymptotic and finite-time analyses. To protect each worker agent cost information from being accessed by possible attackers, we propose a privacy-preserving variant of the algorithm by adding perturbation to the exchanged information. We show the rigorous differential privacy guarantee by using moments accountant and derive an upper bound of the utility loss for the privacy-preserving algorithm. Evaluations are also provided to corroborate the efficiency of the algorithms.