Research on Global BloomFilter-Based Data Routing Strategy of Deduplication in Cloud Environment
Qinlu He, Zhen Li, Chen Chen, Hao Feng · IETE Journal of Research · 2023
The application of data deduplication technology reduces the demand for data storage and improves resource utilization. Compared with limited storage capacity and computing capacity of a single node, cluster data deduplication technology has great advantages. However, the cluster data duplication technology also brings new issues on deduplication rate reduction and load balancing of storage nodes. The application of data routing strategy can well balance the problem of deduplication rate and load balancing. The paper introducesa global BloomFilter routing strategy. In order to avoid the communication overhead caused by sending the fingerprints to the data storage node and inquiring about the BloomFilter maintained in the memory, a BloomFilter array is maintained in the memory of the client-server. Each row of the array corresponds to a storage node; before sending the Superchunk to the storage node, it will inquire the BloomFilter array and storage capacity information to get the optimal node. The theoretical analysis and experimental results prove the feasibility of the strategies proposed by this paper.