PsiDB: A Framework for Batched Query Processing and Optimization
Mehrad Eslami, Yi-Cheng Tu, Hadi Charkhgard, Zichen Xu, Jiacheng Liu · 2019
While work in Techniques based on sharing data and computation among queries developed algorithms and systems that are shown to be effective, there is a lack of logical foundation for query processing and optimization. In this paper, we present PsiDB, a system model for processing a large number of database queries in a batch. The key idea is to generate a single query expression that returns a global relation containing all the data needed for individual queries. For that, we propose the use of a type of relational operators called ψ-operators in combining the individual queries into the global expression. We tackle the algebraic optimization problem in PsiDB by developing equivalence rules to transform concurrent queries with the purpose of revealing query optimization opportunities. Experiments conducted on an early prototype of PsiDB show a major performance improvement over a mainstream commercial DBMS.