The Application of Improved Data Duplicate Elimination Method in Vertical Research Engine
Zhu Hong-peng · Journal of Shaoyang University · 2012
This article analyzes comprehensively the data duplicate elimination method.The experiments show that the single and multiple MD5 algorithms play very important role in data duplicate elimination method.The application of the new algorithm,combined by these two algorithms,in the vertical research engine of electronic products turns out to be very effective,building up a solid foundation for index module.