Multimodal User Interface for Mission Planning
A. Medl, Ivan Marsic, Marco Antonio Cortina Saint André, Casimir A. Kulikowski, James L. Flanagan · 1998
This paper 1 presents a multimodal interface featuring fusion of multiple modalities for natural human-computer interaction. The architecture of the interface and the methods applied are described, and the results of the real-time multimodal fusion are analyzed. The research in progress concerning a mission planning scenario is discussed and other possible future directions are also presented. Introduction Current human-machine communication systems predominantly use keyboard and mouse inputs that inadequately approximate human abilities for communication. More natural communication technologies such as speech, sight and touch, are capable of freeing computer users from the constraints of keyboard and mouse. Although they are not sufficiently advanced to be used individually for robust human-machine communication, they have adequately advanced to serve simultaneous multisensory information exchange (Cohen et al. 1996, Waibel et al. 1995). The challenge is to properly combine these t...