Dynamic Multi-Resource Optimization for Storage Acceleration in Cloud Storage Systems
Kyungtae Lee, Jinhwi Kim, Jeongho Kwak, Yeongjin Kim · IEEE Transactions on Services Computing · 2022
Demand for using cloud object storage has been increasing in order to efficiently manage a large number of binary large objects (BLOBs), including videos, photos and documents. Although many companies and institutions are currently trying to utilize public cloud object storage services such as AWS Simple Storage Service (S3), most of existing encoding systems for safe storage of data have not been optimized for current cloud object storage architecture. In this article, we propose a novel dynamic extreme erasure encoding algorithm, namelyDexEncodingaiming to maximize the utility of clients where the encoding locations in the cloud storage architecture are dynamically optimized between gateway and storage servers with respect to the time-varying cloud environment. Here, the utility captures the satisfaction of clients for the speed of data storage and fairness among clients.DexEncodingefficiently resolves resource bottlenecks by adapting to the dynamic network, processing and storage resource availability and storage request. Real measurement-driven simulations demonstrate that the proposedDexEncodingalgorithm drastically outperforms that applied in the state-of-the-art object storage systems in a perspective of clients’ satisfaction.