On the Feasibility of Geographically Distributed Web Crawling
Berkant Barla Cambazoglu, Flavio Junqueira, Vassilis Plachouras, Luca Telloli · 2008
We identify the issues that are important in design of a geographically distributed Web crawler. The identified issues are discussed from a "benefit" and "challenge" point of view. More specifically, we focus on the effect of geographical locality of Web sites on crawling performance, and, as a prac