Web Crawling As Nonlinear Dynamics
Chaitanya Raveendra · 2013
Web search engines work by storing information about many web pages, which they retrieve from the WWW itself. These pages are retrieved by a Web crawler, an automated Web browser which follows every link it sees. The contents of each page are then analyzed to determine how it should be indexed. In this paper we show that the web crawling is a nonlinear problem and the various methods and architectures that are evolved during the research of enhancing the performance of the search engines.