Survey of High-performance Web Crawler
LI Zhou-jun · 2009
Web Crawlers,one of basic components of Search Engine,are programs to download resources from Internet.We illuminated the work theory of the Web Crawlers,and its development,and how to design a high-performance,scalable,distributed Web crawler,including the faced key problem.