Research on topic crawling algorithm based on link and content
Hongyan Wang · Jisuanji yingyong yanjiu · 2011
This paper studied the method of vertical search engine to obtain the resources related with the tile effectively.Firstly,proposed the improved PageRank algorithm to measure the link similarity of the page.Secondly,put forward the similarity based on the content by using the url,title and text of each page.Finally,proposed BLCT topic crawling algorithm based on link and content by combining content similarity with link similarity.The experimental results show that proposed algorithm performs better in the average harvest rate and target recall rate,and the crawled pages relevant to the topic is more than the previous algorithm.