Focused Crawler Based on Simulated Anneal Algorithm
Cai Xin-bao · Computer Technology and Development · 2009
Focused crawler is the core and foundation of the topic-specific search engine.Special crawling strategy quality gives a direct impact on search results.In order to select more relevant pages,through using the simulated annealing mechanism to choose the next to visit,makes those high overall value link have the opportunity to be selected early in the search,and using Tunneling to broaden the searching scope.When calculating the value,consider the value of the page content and the text synchronously,and according their different impact to the value,gives them different weight.Experiments indicate that the method has a good effectiveness.