Analysis of Lossless Data Compression Algorithm in Columnar Data Warehouse
Rani Nandkishor Aher, Mandaar Bhaskar Pande · 2022 6th International Conference On Computing, Communication, Control And Automation (ICCUBEA · 2022
Organizations are heading towards a modernization journey. Cloud providers are playing a vital role in this journey. The industry is focused on cost efficiency and ROI since they need a huge investment for the modernization journey. Also, there are overheads for maintaining the legacy systems until they are completely migrated. This puts a lot of focus on cost reduction and is influenced by storage, compression, and performance parameters, which influence the cost directly. In this paper, we focus on studying data compression patterns, specifically BROTLI and ZSTD for columnar databases. We demonstrate structured and unstructured compressed data loading, storage and query execution statistics. For future development, this paper provides insight for further research areas.