Generalized scale independence through incremental precomputation
Michael Armbrust, Eric Liang, Tim Kraska, Armando Fox, Michael J. M. Franklin, David A. Patterson · 2013
Developers of rapidly growing applications must be able to anticipate potential scalability problems before they cause performance issues in production environments. A new type of data independence, called scale independence, seeks to address this challenge by guaranteeing a bounded amount of work is required to execute all queries in an application, independent of the size of the underlying data. While optimization strategies have been developed to provide these guarantees for the class of queries that are scale-independent when executed using simple indexes, there are important queries for which such techniques are insufficient.