Multi Modal Interaction in an Automatic Pool Trainer
Atladottir, R, Gay, J, Jensen, Kasper Løvborg, Jensen, RB, Lontis, I, Larsen, LB, Larsen, S · VBN Forskningsportal (Aalborg Universitet) · 2005
For testing user experience and usability issues an automatic pool trainer has been developed which utilizes multi modal user interaction through computer vision, speech recognition, and agent technologies. This paper presents a non-intrusive system, developed with user tasks in focus, for a standard non-modified pool table, relying on gesture and speech recognition supplementing each other in navigating the intuitive game menu. A camera is used for recognizing the gestures and feedback is given through sounds, speech synthesis and animations projected onto the table. The ease of use of the system has been proven through a number of user tests involving a total of more than 200 users. Further development of the system is discussed with focus on user feedback and exploration of other game schemes.