Distributed storage method based on information dispersal algorithm
Jie Ling, Xiangyang Jiang · 2013
In order to improve the storage efficiency of Hadoop Distributed File System (HDFS) and its load balancing ability, this paper presented a distributed storage method based on information dispersal algorithm (IDA). The method used IDA to encode files to blocks, and stored the blocks in the cluster by the improved data placement strategy. The results and analysis of the experiments show that the method improves the storage efficiency and load balancing ability.