Question Answering for Machine Reading Evaluation.
Álvaro Rodrigo, Anselmo Peñas, Eduard H. Hovy, Emanuele Pianta · 2010
Question Answering (QA) evaluation potentially provides a way to evaluate systems that attempt to understand texts automatically. Although current QA technologies are still unable to answer complex questions that require deep inference, we believe QA evaluation techniques must be adapted to drive QA research in the direction of deeper understanding of texts. In this paper we propose such evolution by suggesting an evaluation methodology focused on the understanding of individual documents at a deeper level.