Automatic Search Engine Performance Evaluation Based on Clustering Analysis
Mingwen Wang · Zhongwen xinxi xuebao · 2010
Traditional search engine evaluation methods need manual annotation of correct answers for a set of queries,which is costly and time comsuming.In this paper,we present an automatic search engine performance evaluation method based on clustering analysis.This method includes three steps: first,computing the coverage score of the query for information;second,clustering the search results by the coverage score;last,evaluating the retrieval performance using intra-cluster cohesion and inter-cluster separation.Experimental results show that the automatic method gets a similar evaluation result with traditional assessor-based ones.