Topic Crawling Strategy Based on Wikipedia and Analysis of Pages' Similarity
Xiaonan Zhao, Li Bo Liu, Deng Wei Wang, Jiao Zheng · Applied Mechanics and Materials · 2012
Considering the weaknesses existing in the present topic crawling strategies, this paper puts forward a new method which is based on Wikipedia and the analysis of page similarity. Firstly, the topic is described via Wikipedia. Then, handle the downloaded web. Finally, calculate the priorities of the links through text relativity and analysis of the web links. The result indicates that this new method is better than the traditional in terms of searching results and topic relativity and is worth popularizing.