A comprehensive model for web search evaluation
Rashid Ali, M. M. Sufyan Beg · 2006
Abstract: – Web searching is such an activity that its importance can just not be ignored in the current scenario. But as there are a number of search engines available, there must be some procedure to evaluate them. In this paper, architecture of a comprehensive web search evaluation system is discussed. We use a number of objective evaluation techniques to supplement the subjective evaluation based on user feedback. The user feedback is obtained implicitly by watching the actions of user on search results in response to his query. These techniques are combined using Modified Shimura technique of Rank aggregation. The aggregated ranking is then compared with the original ranking given by the search engine. The correlation coefficient thus obtained is averaged for a set of queries. We show our experimental results pertaining to seven public search engines and fifteen queries.