Generalized Optimal Storage Scaling via Network Coding
Yuchong Hu, Xiaoyang Zhang, Patrick P. C. Lee, Pan Zhou · 2018
It is critical to support efficient scaling in distributed storage systems so as to meet increasing storage demands with new storage nodes. However, the scaling process incurs substantial scaling bandwidth due to reorganizing currently stored data to new storage nodes. Recent work has applied network coding to minimize scaling bandwidth for a special case where (n, k) MDS codes are scaled to (n', k') MDS codes for n'-k'=n-k. In this paper, we extend the results and prove the minimum scaling bandwidth for a more general setting where (n, k) MDS codes are scaled to (n', k') MDS codes for and k'≥ k. Furthermore, we present a family of MDS code construction that achieves optimal scaling from (n, k) to (n', k') where k=k'.