QDFS: A quality-aware distributed file storage service based on HDFS

Guanghua Song, Jun-na Chuai, Bowei Yang, Yao Zheng · 2011

On the basis of the Hadoop distributed file system (HDFS), this paper presents the design and implementation of QDFS, a distributed file storage service system that employs a backup policy based on recovery volumes and a quality-aware data distribution strategy. The experimental results show that QDFS increases the storage utilization ratio and improves the storage performance by being aware of the quality of service of the DataNodes. The improvements of QDFS compared with HDFS make the Hadoop distributed computing model more suitable to unstable wide area network environments.

Read the paper · More papers on PaperTik