Multimodal system for hands-free PC control

Alexey Anatolievich Karpov, Andrey Leonidovich Ronzhin, Alexander Nechaev, Svetlana Chernakova · 2005

This paper describes the developed multimodal system intended for assistance to people with disabilities of hands. It combines automatic speech recognition and head tracking in one multimodal system. The structure of the system, the methods for recognition and tracking, information fusion and synchronization, the obtained results and testing conditions are described in the paper. This system was applied for hands-free control of Graphical User Interface for such tasks as Internet communication and text editing in MS Word. 1.

Read the paper · More papers on PaperTik