Research on the Web Crawler
Lifa Wu · Computer Knowledge and Technology · 2010
The traditional search engines can not satisfy the demands of getting useful information with the blast developing of information resources on Internet, as the foundation and important part of search engine, the action of the Web Crawler appears especially important, the article introduces the concept of Web crawler, the trouble of crawling and the resolvent, also have a research on four kinds of familiar Web Crawler.