Evaluating Heterogeneous Information Access (Position Paper)
Ke Zhou, Tetsuya Sakai, Mounia Lalmas, Zhicheng Dou, Joemon M. Jose · 2013
Information access is becoming increasingly heterogeneous. We need to better understand the more complex user behaviour within this context so that to properly evaluate search systems dealing with heterogeneous information. In this paper, we review the main challenges associated with evaluating search in this context and propose some avenues to incorporate user aspects into evaluation measures.