Color Plate Section
Elisabeth André, Jean‐Claude Martin, Florian Lingenfelser, Johannes Wagner · 2013
Sophisticated fusion techniques are an essential component of any multimodal system. Historically, systems aimed at analyzing the semantics of multimodal commands and typically investigated a combination of pointing and drawing gestures and speech. The most prominent example includes the “Put-that-there” system (Bolt, 1980) that analyzes speech in combination with 3D pointing gestures referring to objects on a graphical display. Since this groundbreaking work, numerous researchers have investigated mechanisms for multimodal input interpretation mainly working on speech, gestures and gaze while the trend is moving towards intuitive interactions in everyday environments. Since interaction occurs more and more in mobile and tangible environments, modern multimodal interfaces require a greater amount of context-awareness (Johnston et al., 2011).