An efficient framework for parallel and continuous frequent item monitoring
Yu Zhang, Yue Sun, Jianzhong Zhang, Jingdong Xu, Ying Wu · Concurrency and Computation Practice and Experience · 2013
SUMMARY In high‐speed network monitoring, the ever‐growing traffic calls for a high‐performance solution for the computation of frequent items. The increasing number of cores in the current commodity multi‐core processors opens up new opportunities in parallelization. In this paper, we present a novel precision integrated framework (PRIF) that exploits the great parallel capability of multi‐cores to speed up the famousfrequentalgorithm. PRIF equally distributes the input data stream into sub‐threads that use the optimized weightedfrequentalgorithm to track local frequent items. The items with frequency increments exceeding a pre‐defined threshold are sent to a merging thread which is able to return the global continuousε‐deficient frequent items. The theoretical correctness and complexity analyses are presented. Experiments with real and synthetic traces confirm the theoretical analyses and demonstrate the excellent performance as well as the effects of parameters and data skewness. The results show that PRIF is able to provide continuous frequent items and near‐linear speedup at the cost of greater memory use. Copyright © 2013 John Wiley & Sons, Ltd.