Computational Characteristics of Multimodal Dialogue
Kris R. Thrisson · 1998
This paper examines some of the general characteristics of real-time multimodal, face-toface interaction that set it apart from other issues in AI and human-computer interaction. It argues that a real-time multimodal system needs to be designed in layers and include both reactive and reflective behaviors. It presents a layered feedback-loop model of face-to-face dialogue and shows how contextual analysis of the function of multimodal acts is linked with feedback generation and interpretation. A brief description is given of a modular architecture called Ymir, based on the proposed model, for modeling psychosocial dialogue skills.