Axiometrics: Axioms of Information Retrieval Effectiveness Metrics
Eddy Maddalena, Stefano Mizzaro · 2014
There are literally dozens (most likely more than one hun-dred) information retrieval effectiveness metrics, and count-ing, but a common, general, and formal understanding of their properties is still missing. In this paper we aim at improving and extending the recently published work by Busin and Mizzaro [6]. That paper proposes an axiomatic approach to Information Retrieval (IR) effectiveness met-rics, and more in detail: (i) it defines a framework based on the notions of measure, measurement, and similarity; (ii) it provides a general definition of IR effectiveness metric; and (iii) it proposes a set of axioms that every effectiveness met-ric should satisfy. Here we build on their work and more specifically: we design a different and improved set of ax-ioms, we provide a definition of some common metrics, and we derive some theorems from the axioms. 1.