The Optimal Quantile Estimator for Compressed Counting
Li, Ping · arXiv (Cornell University) · 2008
Compressed Counting (CC) was recently proposed for very efficiently computing the (approximate) $α$th frequency moments of data streams, where $0 1$, the complexity of CC (using the geometric mean estimator) is $O(1/ε)$, breaking the well-known large-deviation bound $O(1/ε^2)$. The case $α\approx 1$ has important applications, for example, computing entropy of data streams. For practical purposes, this study proposes the optimal quantile estimator. Compared with previous estimators, this estimator is computationally more efficient and is also more accurate when $α> 1$.