Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models
Guglielmo Faggioli, Nicola Ferro, Norbert Fuhr · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · 2022
Being able to compare Information Retrieval(IR) systems correctly is pivotal to improving their quality. Among the most popular tools for statistical significance testing, we list t-test and ANOVA that belong to the linear models family. Therefore, given the relevance of linear models for IR evaluation, a great effort has been devoted to studying how to improve them to better compare IR systems.