A mobile phone information search engine based on Heritrix and Lucene

Jianxia Chen, Wei Ming Wu, Chunzhi Wang · 2012

With the rapid spread of web application, the search engine based on personalized services becomes more important in the society. The paper proposes an approach to design and implement a personalized search engine based on Heritrix and Lucene. In particular, the design a web crawler of mobile information with URL hashing algorithm, achieving the multithread and efficient web crawl. Experimental results show the efficient performance.

Read the paper · More papers on PaperTik