A Lightweight Learned Cardinality Estimation Model

Yaoyu Zhu, Jintao Zhang, Guoliang Li, Jianhua Feng · IEEE Transactions on Knowledge and Data Engineering · 2025

Cardinality estimation is a fundamental task in database management systems, aiming to predict query results accurately without executing the queries. However, existing techniques either achieve low estimation accuracy or take high inference latency. Simultaneously achieving high speed and accuracy becomes critical for the cardinality estimation problem. In this paper, we propose a novel data-driven approach calledCoDe(Covering with Decompositions) to address this problem.CoDeemploys the concept of covering design, which divides the table into multiple smaller, overlapping segments. For each segment,CoDeutilizes tensor decomposition to accurately model its data distribution. Moreover,CoDeintroduces innovative algorithms to select the best-fitting distributions for each query, combining them to estimate the final result. By employing multiple models to approximate distributions,CoDeexcels in effectively modeling discrete distributions and ensuring computational efficiency. Notably, experimental results show that our method represents a significant advancement in cardinality estimation, achieving state-of-the-art levels of both estimation accuracy and inference efficiency. Across various datasets,CoDeachieves absolute accuracy in estimating more than half of the queries.

Read the paper · More papers on PaperTik