AMS-Sampling in Distributed Monitoring, with Applications to Entropy.
Jiecao Chen, Qin Zhang · arXiv (Cornell University) · 2014
Modern data management systems often need to deal with massive, dynamic and inherently distributed data sources: we collect the data using a distributed network, and at the same time try to maintain a global view of the data at a central coordinator. Such applications have been captured by the distributed monitoring model, which has attracted a lot of attention recently in both theory and database communities. However, all proposed algorithms in distributed monitoring with provable guarantees are ad-hoc in nature, each being designed for a specific problem. In this paper we propose the first generic algorithmic approach, by adapting the celebrated AMS-sampling framework from the streaming model to distributed monitoring. We also show how to use this framework to monitor entropy functions. Our results significantly improve the previous best results by Arackaparambil et al. [2] for entropy monitoring.