A data skew handling method based on the minimum spatial proximity for parallel spatial database
Yan Jie Zhou, Qing Xin Zhu, Yeting Zhang · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2009
Data skew is one of most important reasons to deteriorate the performance of parallel spatial database. This paper studies the issues of handling data skew in shared nothing parallel spatial database system architecture. A novel data skew handling method is proposed, which fulfill spatial data distribution balancing based on the spatial proximity of data fragments. The minimum spatial proximity is used to be the principle of moving data fragments among different network parallel nodes. Our experimental results show that the proposed data skew handling method can achieve dynamic data load balancing and offer significant improvement for reducing response time of parallel spatial queries.