Modeling and Guiding Cooperative Multimodal Dialogues
Adelheit Stein, Elisabeth Maier · 1993
In this paper we claim that a consistent conversational approach to human-computer interaction can be applied feasibly to mul-timodal interaction. A comprehensive conversational model is presented that covers interrelated levels of the dialogue struc-ture, i.e. illocutionary, rhetorical, and topical aspects. It thus provides the basis for a consistent interpretation of the linguis-tic as well as graphical actions of both participants during the ongoing dialogue. The model comprises a descriptive part cap-turing local dialogue tactics and the possible patterns of ex-change. In our prototypical information system MERIT we have integrated another prescriptive part that relates sequences of dialogue contributions to global information-seeking strate-gies and allows a dialogue to be guided by dialogue scripts. 1