Study on Efficiency of the Search Engine Spiders Crawl the Page
Jun Jie Lin · Applied Mechanics and Materials · 2013
This paper describes the search engine spiders crawl the web content in the algorithm, and compare the advantages and disadvantages of several algorithms. In the Windows Server platform, using PHP + MYSQL test of the development environment. Through practical experience, discussed and summarized in the search spiders to crawl pages principle