Distributed Gaussian Process: New Paradigm and Application to Wireless Traffic Prediction
Yue Xu, Feng Yin, Wenjun Xu, Jiaru Lin, Shuguang Robert Cui · 2019
Distributed Gaussian Process (GP) is a scalable Bayesian method that is promising for handling big data. Our contribution in applying GP for traffic prediction is two-fold. First, to the best of our knowledge, this paper is the first to empower GP regression with the alternating direction method of multipliers (ADMM) for distributed hyper-parameter optimization in the training phase, where the ADMM training framework well balances local estimation and information consensus in a principled way. Second, in the prediction phase, we fuse local predictions obtained from distributed computing units via a cross-validation based optimal strategy, which demonstrates itself to be reliable and robust for general regression tasks. Moreover, the cross-validation based optimal fusion strategy is built upon a well acknowledged probabilistic model to retain the valuable closed-form GP prediction properties. Experimental results show that our proposed distributed GP model can outperform the state-of-the-art distributed GP models considerably, in terms of wireless traffic prediction performance.