Towards the Evaluation of Voice-Activated Question Answering Systems: Spontaneous Questions for QAST 2009
Davide Buscaldi, Paolo Rosso, Jordi Turmo, Pere R. Comas · 2015
Abstract. This is a preliminary report of the work carried out in order to introduce “spontaneous ” questions into QAST at CLEF 2009. QAST (Question Answering in Speech Transcripts) is a track of the CLEF cam-paign. The aim of this report is to show how difficult can be to generate “spontaneous ” questions and the importance to take into account the real information needs of users for the evaluation of question answering systems. 1