Enhancing Referential Success by Tracking Hearer Gaze
Alexander Koller, Konstantina Garoufi, Maria Staudte, Matthew W. Crocker · 2012
The ability to monitor the communicative suc-cess of its utterances and, if necessary, provide feedback and repair is useful for a dialog sys-tem. We show that in situated communication, eyetracking can be used to reliably and effi-ciently monitor the hearer’s reference resolu-tion process. An interactive system that draws on hearer gaze to provide positive or nega-tive feedback after referring to objects outper-forms baseline systems on metrics of referen-tial success and user confusion. 1