Allocating Media and Modalities According to Physical Constraints and Information Types within a Theory of Interaction
Patrice Clemente · 2005
Abstract: In this paper we introduce a formal framework for the modelling of rational multimodal dialoguing agents. Based on a rational theory of interaction, the framework enables agents to be conscious of several aspects of the communication: the characteristics of the user, the environment (noisy states, failing modes, etc.), the (un-)available media and modalities, the communicative goals and the types of information to produce. These agents are based on “traditional ” rationality principles extended with multimodal rules. These principles and rules are defined as a set of generic axioms, which enables agents to plan communicative acts, that actually are multimodal acts. As the agents have a description of the entire communication process, they are not limited in number or kinds of media and modalities. Moreover, the generic and task specific rules of multimodal behavior enable these agents to adapt to the applicative context and environment. In this paper, we will focus on the following aspects: the ability of the agents to take care of the user’s preferences and explicit choices, the personal data, the physical handicaps, the dynamic management of own media (failures, additions to the current dialogue, etc.), and the allocation of modalities by the system.