Research of vertical search engine technology based on clustering algorithm
Yue Ming · Journal of Beijing Information Science & Technology University · 2013
A vertical search engine is designed and implemented based on similar clustering algorithm.By using web crawler NWebCrawler and the custom regular expressions,useful URLs is crawled efficiently.Through analyzing the information of URL,structured data are extracted.The key words are segmented by using positive maximum matching algorithm and the value of the searching results is clustered by using VSM(vector space model).Finally,index is created based on Lucene and information is retrieved.The experimental results show that the vertical search engine based on similar clustering algorithm is higher on the rate of accuracy and recall.Compared with the ordinary vertical search engine,it has a function of inquiring similar products.