Research of HDFS consistency management
Zejun Jiang · Modern Electronics Technique · 2012
HDFS is a storage system of open source cloud computing project Hadoop.It has good fault tolerance and scalability,but the original consistency model of HDFS can not be applied to the task which has high real-time request but high data integrity requirement is not strict.The overall architecture of HDFS,read/write process,and HDFS limitations and shortcomings are analyzed in the view of data consistency.The solutions are proposed.NWR model was introduced into HDFS and read/write lock mechanism was improved as multi-granularity lock mechanism.Experimental results prove that through the above measures,the users are allowed to configure their cloud storage system,and balance the consistency and availability according to their own needs.