Demo Paper: Large Scale Spatial Data Processing With User Defined Filters In BBoxDB
Jan Kristof Nidzwetzki, Ralf Hartmut Güting · 2019
BBoxDB is a distributed key-bounding-box-value store which is capable of handling large scale n-dimensional data. Unlike existing key-value stores, each value is stored together with a bounding box which describes the location of the value in an n-dimensional space. BBoxDB splits large datasets automatically and spreads them across a cluster of nodes. The software works primarily on the bounding boxes of the stored data; operations like range queries or joins take only the bounding boxes of the data into consideration. In version 0.9.1, we implemented support for user defined filters (UDF) in BBoxDB; UDFs operate on the real values of the data. In this paper, we describe this novel feature for the first time. As an example, a UDF is developed in this paper which is capable of handling GeoJSON encoded data. The UDF consists only of a few lines of code and turns the generic distributed datastore BBoxDB into a specialized system that is capable of processing large scale GeoJSON encoded datasets. Operations like spatial joins or range queries on the real geometries of the data become possible. During our demonstration, we show the implementation of the UDF and perform range queries and spatial joins. The used dataset contains spatial data of the whole world and is obtained from the Open Street Map project. For visualization, the GUI of BBoxDB was extended in a way that spatial queries can easily be executed. Using the GUI, query results can be interactively explored; they are shown as an overlay on a map dynamically fetched from the Open Street Map project.