User-centered evaluation of question answering systems
Chorng‐Shyong Ong, Min-Yuh Day, Kuo-Tay Chen, Wen-Liar Hsu · 2008
With the rapid growth of the Internet and database technologies in recent years, question answering systems (QAS) have emerged as important applications. As most evaluation models focus on system-centered evaluation, user-centered evaluation has attracted little attention. Although many QAS have been implemented, little work has been done on the development of a user-centered evaluation for QAS. User-centered evaluation is used to understand a userpsilas needs and identify important dimensions and factors in the development of an information system in order to improve its acceptance. The purpose of this study is to develop a user-centered evaluation model for QAS from the userpsilas perspective. The proposed user-centered evaluation model provides a framework for the design of question answering systems from the userpsilas perspective to enhance user satisfaction and acceptance of QAS.