Quantitative Measurement of Scores by Ranks
M. Gayatri, MHM Krishna Prasad · 2011
Ranking, which to have a position higher or lower than others and consists of listing of items in a group, such as schools or sports teams, according to a system of rating or a record of performance. It is performed on the basis of some scores available for each item. Comparing two different rankings has been studied in various fields. In each case, a measure has been provided that takes into account how much the positions of each item differ in the two ordered lists. The existing practice for comparing scoring functions is to compare the induced rankings by one of a large number of rank comparison methods available in the literature. In our paper we demonstrate that our approach outperforms the previously proposed automatic ranking method. For comparing the similarity of rankings of two search engines, the Spearman correlation coefficient is computed. When comparing more than two sets Kendall's W is used. We suggest that it may be better to compare the underlying scores themselves. To this end, a generalized Kendall distance is defined .which takes into consideration not only the final ordering that the two schemes produce but also at the spacing between pairs of scores. Experimental results clearly show the advantages score comparison has over rank comparison.