Beyond measuring performance
Peter B. Golbus · 2014
In this work, we address information retrieval evaluation and the methods and metrics used for such evaluations. We consider the relative lack of understanding in this area to be the crucial problem in advancing information retrieval. To that end, we introduce several frameworks for meta-evaluation and describe how their unification with evaluation measures can lead to improvements in assessing the quality of information retrieval systems.