Adaptive Queuing Censoring for Big Data Processing

Hongbin Zhu, Hua Lin Qian, Xiliang Luo, Yang Yang · IEEE Signal Processing Letters · 2018

In the era of big data, adaptive censoring (AC) provides us a natural option of trimming data by only keeping the statistical informative data. However, the data chosen by AC may arrive in clusters, which do not relieve the computational resource requirement as expected. In this letter, we exploit queuing theory to model a single sink node with abundant sensor nodes. By adding a buffer to censored distributed wireless sensor networks (WSNs), the uncensored data can be modeled as a queue. With the buffer, the new algorithm entails simple, closed-form updates, and has no loss in terms of estimation accuracy comparing to the original AC method. The proposed model can further reduce the communication cost of distributed WSNs. The proposed model is illustrated in a linear regression setting. Numerical results validate the effectiveness of the proposed model in dealing with data congestion problem.

Read the paper · More papers on PaperTik