Key technologies of distributed search engine based on Hadoop
Yangsen Zhang · Journal of Beijing Information Science & Technology University · 2011
To solve the bottleneck produced by the centralized search engines,more and more people are now doing researches by using distributed technologies.A distributed search engine is realized by Hadoop in this paper.Then three key points about distributed search engine are analysed,including the building of index table,the processing of segmentation and preprocessing of index table.Finally,experiments comparing the centralized search engine and distributed search engine shows the strength of distributed search engine based on Hadoop in dealing with data.