Energy Conservation Storage Strategy of HDFS for Massive News Data
Zhong Jian · Jisuanji gongcheng · 2015
Based on the access rules of news data,this paper proposes an improved Hadoop Distributed File System(HDFS).In order to realize system efficiency energy conservation storage,the nodes without tasks are transitioned to standby mode through the data node partition strategy,file migration strategy and node standby strategy.Additionally,to increase the probability of node standby and balance data distribution in the cluster,it improves the traditional HDFS write file strategy.The data block is written in the active node with largest available space,and the files created in the same time period are distributed to different nodes.Experimental result shows the HDFS based on energy conservation storage strategy saves more than20% energy than traditional HDFS,99.9%respones time of reading files are not affected,and it has good data storage and access performance.