Of Ivory and Smurfs: Loxodontan MapReduce Experiments for Web Search
Jimmy Lin, Donald Metzler, Tamer Elsayed, Lidan Wang · 2009
This paper describes Ivory, an attempt to build a distributed retrieval system around the open-source Hadoop implemen-tation of MapReduce. We focus on three noteworthy aspects of our work: a retrieval architecture built directly on the Hadoop Distributed File System (HDFS), a scalable Map-Reduce algorithm for inverted indexing, and webpage clas-sification to enhance retrieval effectiveness. 1.