Design and Implementation of Web Crawler

Dong Ri-zhuan · Computer Knowledge and Technology · 2014

With the rapid development of society, a sharp increase in information capacity on the Internet, people rely on search engines is growing. As one of the key technologies of Web crawler search engines, but also an effective tool for quick access to the available resources on the network. In order to understand web crawler better and apply it into various applications and systems more skillful and reasonably. After analyze and understand the framework, basic workflow, grab strategy of web crawler, use programming language of Java and HTML parsing tools jsoup and MySQL database implements a web crawler, crawling Jingdong book data simply in order to analysis user's preferences and purchase predisposition, so that to provide users with personalized service.

Read the paper · More papers on PaperTik