Real-time decision making in multimodal face-to-face communication
Kristinn R. Þórisson · 1998
This paper describes an architecture and mechanism for simulating real-time decision making as observed in full-duplex, multimodal face-to-face interaction between humans. The work bridges between multimodal perception and multimodal action generation and allows flexible implementation of multimodal, fullduplex, conversational characters. It is part of a broad computational model of psychosocial dialogue skills called Ymir. The architecture has been tested with a prototype humanoid, Gandalf [34][35]. Gandalf can engage in taskoriented dialogue with a person and has been shown capable of fluid turn-taking and multimodal interaction [40]. The primary focus in this paper is the real-time decision-making (action selection) mechanism of Ymir and its relation to the multimodal perception and motor control systems. 1.1 Keywords Real-time decision making, agent architectures, multimodal, faceto-face communication 2.