Exploiting Stopping Time to Evaluate Accumulated Relevance
Marco Ferrante, Nicola Ferro · 2020
Evaluation measures are more or less explicitly based on user models which abstract how users interact with a ranked result list and how they accumulate utility from it. However, traditional measures typically come with a hard-coded user model which can be, at best, parametrized. Moreover, they take a deterministic approach which leads to assign a precise score to a system run.