Leveraging Context-Free Grammar for Efficient Inverted Index Compression
Zhaohua Zhang, Jiancong Tong, Haibing Huang, Jin Tao Liang, Tianlong Li, Rebecca J. Stones, Gang Wang, Xiaoguang Liu · 2016
Large-scale search engines need to answer thousands of queries per second over billions of documents, which is typically done by querying a large inverted index. Many highly optimized integer encoding techniques are applied to compress the inverted index and reduce the query processing time. In this paper, we propose a new grammar-based inverted index compression scheme, which can improve the performance of both index compression and query processing.