Improved Shark-Search algorithm based on page segmentation
Zhumin Chen · Journal of Shandong University · 2007
A Shark-Search algorithm is one of the classical algorithms for focused crawling.However,its performance is not ideal for crawling Web pages which contain too many noisy links.An improved Shark-Search algorithm based on page segmentation was proposed,which can accurately evaluate the relevance from three granularities: page,block and single link.Several experiments were carried out to verify that the improved Shark-Search algorithm can obtain significantly higher efficiency than traditional ones.