Distributed Adaptive Learning Under Communication Constraints
Marco Carpentiero, Vincenzo Matta, Ali H. Sayed · IEEE Open Journal of Signal Processing · 2023
We consider a network of agents that must solve an online optimization problem from continual observation ofstreamingdata. To this end, the agents implement a distributedcooperativestrategy where each agent is allowed to performlocalexchange of information with its neighbors. In order to cope with communication constraints, the exchanged information must be compressed to reduce the communication load. We propose a distributed diffusion strategy nicknamed as ACTC (Adapt-Compress-Then-Combine), which implements the following three operations: adaptation, where each agent performs an individual stochastic-gradient update; compression, which leverages a recently introduced class ofstochastic compression operators; and combination, where each agent combines thecompressedupdates received from its neighbors. The main elements of novelty of this work are as follows:$i)$adaptivestrategies, where constant (as opposed to diminishing) step-sizes are critical to infuse the agents with the ability of responding in real time to nonstationary variations in the observed model;$ii)$directed, i.e., non-symmetric combination policies, which allow us to enhance the role played by the network topology in the learning performance;$iii)$global strong convexity, a condition under which the individual agents might feature even non-convex cost functions. Under this demanding setting, we establish that the iterates of the ACTC strategy fluctuate around the exact global optimizer with a mean-square-deviation on the order of the step-size, achieving remarkable savings of communication resources. Comparison against up-to-date learning strategies with compressed data highlights the benefits of the proposed solution.