Reinventing Infobright’s Concept of Rough Calculations on Granulated Tables for the Purpose of Accelerating Modern Data Processing Frameworks
Mateusz Wnuk, Sebastian Stawicki, Dominik Ślȩzak · 2020
We present an approach to data and information granulation known from the Infobright Community Edition (ICE) analytical database engine, now reimplemented within the two popular scalable data processing frameworks: Apache Parquet and ROOT. Both of these libraries, do not directly realize the idea of resolving queries based on rough-set-driven calculations on granulated data statistics, what was one of the biggest accelerators in ICE. We summarize the implementation of such level of operations and compare the performance of analytical SQL queries in ROOT, Parquet, and ICE.