Intelligent web crawler
Prashant Dahiwale, Anil Mokhade, Mukesh M. Raghuwanshi · 2010
As the number of Internet users and the number of accessible Web pages grows, it is becoming increasingly difficult for users to find documents that are relevant to their particular needs. Users must either browse through a large hierarchy of concepts to find the information for which they are looking or submit a query to a publicly available search engine and wade through hundreds of results, most of them irrelevant.