Replica Replication Strategy Based on Data Block Heat
Jing Zhang, Hongbo Sun, Shijing Yuan · 2019
HDFS adopts the multi-copy storage strategy of Rack-Aware. However, the default policy does not take into account the load characteristics of the cluster comprehensively, which will result in the unbalanced load of the cluster. Aiming at the defects of HDFS default replica replication strategy, this paper proposes a replica replication strategy based on block heat. According to the heat from the high to the failure of data blocks start copy operation. The results show that the improved strategy is better than the HDFS default strategy in load balancing performance, and the response speed is significantly better than the HDFS default strategy.