Improvement of Focused Crawling Strategy Based on Genetic Algorithm
Wan Wanggen · Jisuanji fangzhen · 2010
Aiming at the subject drifting problem of topic crawling,this paper presents an improved strategy.Based on Genetic Algorithm,this strategy absorbs the idea of the PageRank algorithm and correlation of page,re-sets the fitness function and adjusts the size of correlation parameters of page by it.In this way,the superior gene is selected first and the subject drifting is reduced while delivering.Compared with previous strategies based on genetic algorithm,without prejudice to recall the circumstances,the number of pages relevant to the subject can raise more than 5%.