Interaction Pool: Towards a user-centred test collection
Hideo Joho, Robert Villa, Joemon M. Jose · 2007
The advance of evaluation methodology is essential for the development of interactive systems that are based on the understanding of information seeking behaviour. This position paper presents a (rough) design of a community-based approach called the interaction pool, a repository of annotated interaction data that can be harnessed and shared by a research community interested in information seeking behaviour, interaction design, interface engineering, and realistic system evaluation. The design of such a repository was motivated by the need to develop a user-centred test collection which inherited the advantages of existing systemcentred test collections while considering the characteristics of user-centred research and development.