A 3D Gesture Recognition System for Multimodal Dialog Systems

Robert Neßelrath, Jan Alexandersson · 2009

We present a framework for integrating dynamic gestures as a new input modality into arbitrary applications. The framework allows training new gestures and recognizing them as user input with the help of machine learning algorithms. The precision of the gesture recognition is evaluated with special attention to the elderly. We show how this functionality is implemented into our dialogue system and present an example application which allows the system to learn and recognize gestures in a speech based dialogue.

Read the paper · More papers on PaperTik