A vector map overlay algorithm based on distributed queue
Zhuojian Xiao, Qiang Qiu, Jinyun Fang, Shaolong Cui · 2017
Vector map overlay is a core operation in the fields of spatial information processing. To meet the demand of overlay analysis with large scale vector data, this paper proposes a vector map overlay algorithm based on distributed task queue and designs a desirable task structure composed of geometries pair and a task assignment strategy based on spatial location. As well known, data access and load balancing are two significant problems in clustered environment. As spatial vector data are distributed imbalance, the two problems have an explicit influence on the performance of distributed vector map overlay algorithm. The task assignment strategy we propose has a greatly performance to improve the cache utilization under the condition of guaranteeing distributed load balancing. We have simulated experimented with 64 computing nodes and achieved 62% cache utilization and an ideal load balancing.