A Web Spider's Searching Algorithm Based on Non-Greedy Policy
Xue Li · Computing Technology and Automation · 2004
Based on the analyses of the deficiencies of the traditional Web spider's searching strategies, this paper proposes a non-Greedy link-selection policy. Then a heuristic searching algorithm based on non-Greedy policy is proposed. We validate our new algorithm by experiments of searching computer-relevant papers on the Web sites of four famous computer departments. The results show that the new algorithm has better performance.