Parallel skyline computation for frequent queries in distributed environment
Rohit Kulkarni, B. F. Momin · 2016
Skyline queries produce the tuples which are `promising' on the dimensions of the user's interest. The popular datasets often get queried by the users where dimensions of the user queries often overlap. For such frequent, overlapping skyline queries, repeating computations on large datasets result into unacceptable response time. In the scenarios where, there exists a little deviation in the query dimensions than those of the popular dimensions, the re-use of the previous results can help in either avoiding or reducing the further computational costs. In this paper we focus exactly on this problem and aim at optimizing the response time of frequent and near to frequent skyline queries raised against the distributed datasets. We propose a novel, simple yet efficient algorithm namely the PQPSkyline which makes use of our previously proposed data structure called as `Query Profiler'. The centralized server receives the skyline queries and works for the allocation of the peers where the horizontal splits of the dataset are available and the peers work in parallel fashion. The experiments performed on the real life dataset demonstrate, effectiveness and scalability of the proposed algorithm.