Memory efficient fork-based checkpointing mechanism for in-memory database systems
Jiwoong Park, Yunjae Lee, Heon Young Yeom, Yongseok Son · 2020
Consistent checkpointing is an essential technique for in-memory databases (IMDBs) to achieve some persistence to data. Towards a fast consistent checkpointing with low overhead and low memory footprint, many consistent checkpointing algorithms have been proposed. However, recent work revealed that the simple fork-based checkpointing scheme used for industrial IMDBs could indeed outperform the state-of-the-arts in terms of average latency, latency spike, and implementation effort. On the other hand, the existing fork-based checkpointing scheme has a memory footprint issue, which remains unsolved; memory usage increases incrementally (up to 2x) during checkpointing for update-intensive workloads.