Duplicate data delete technology based on double bloom filter
XI Yewe · Computer Engineering and Applications Journal · 2014
Aiming at the disadvantage of file level single bloom filter duplicate data delete algorithm deletes duplicate data only at file size, block level single bloom filter duplicate data delete algorithm's time-consuming is too much. In this paper,it uses 2 bloom filter, creates a 2 level duplicate data delete algorithm structure-file level and block level. The experimental results show that, double bloom filter duplicate data delete algorithm could delete duplicate data at block level, keep false positive error rate at a low level, time-consuming gets 43%~68% shorter compared with block level single bloom filter duplicate data delete algorithm.