Region Clustering Based Multiple Query Optimization

Pei Xuan Fei, Cai Chen, Yi Liang · 2018

In order to solve the problem of low efficiency in dealing with large numbers of queries in Hive, we propose a multi-queries region clustering (MQRC) method to improve the overall performance.This method makes effective use of the region overlap between queries and the region aggregation of query sets.By clustering the query set, we divide some queries with high similarity into a group, and share a materialized view within the group, which can effectively reduce the overhead of the query set.The experimental results show that, the method proposed in this paper is superior to the traditional method.It can shorten the time of queries.

Read the paper · More papers on PaperTik