Parallel pagerank computation on a gigabit PC cluster
Bundit Manaskasemsak, Arnon Rungsawang · 2004
Efficient computing the PageRank scores for a large Web graph is actually one of the hot issues in Web-IR community. Recent research projects have been proposed to accelerate the computation, both in algorithmic and architectural ways. We focus on a parallel PageRank computational architecture on a cluster of Opteron PCs networked via a gigabit Ethernet. We propose both an efficient parallel algorithm of the standard PageRank computation, and a simple pairwise communication model needed to synchronize local PageRank scores between processors. Our experimental results conducted on a large Web graph, over 1.5 billion links, synthesized from the real set of crawled Web pages in the TH domain, are quite promising. The current implementation takes less than 15 seconds for an iteration run.