Duplicate Checking Algorithm of Document Partial Content Based on Particle Swarm Optimization
Xiaodong Wang · Jisuanji gongcheng · 2011
There are some algorithms which can detect similarity among documents,but these algorithms can not detect the duplicated of partial contents in documents.A new effective algorithm of the duplicated of partial contents detection in documents is put forward in this paper.It uses Particle Swarm Optimization(PSO) algorithm to search the optimized partial contents which is the most similar in two documents.For PSO algorithm,it provides the encoding of the particles.A new related coefficient of strings is defined for strings similarity.And the new evaluation function of PSO is designed based on the related coefficient function.The hybrid mutation PSO algorithm is used for searching the most similar partial contents quickly and accurately.Simulation experiments indicate that the algorithm can search the most similar partial contents in two documents effectively.