SeqCDC: Hashless Content-Defined Chunking for Data Deduplication
Sreeharsha Udayashankar, Abdelrahman Baba, Samer Al-Kiswany · 2024
Data deduplication is critical to cloud storage providers and is widely employed to conserve server-side storage space. Data chunking is an important aspect of deduplication, being directly responsible for storage space savings and end-to-end system throughput. While deduplication systems deployed in production favor larger chunk sizes, existing data chunking algorithms are slow and offer minimal throughput increases with increasing chunk size.