Articulating Action in Multimodal Interaction
Nadia Bianchi‐Berthouze, Paolo Bottoni · UCL Discovery (University College London) · 2002
The space of multimodal interaction is richer than the one for direct manipulation of WIMP interfaces. Yet, it is possible to identify a common structure, and de ne abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic architecture, and introduce a classi cation of actions. Interaction design, as well as personalisation, becomes the problem of mapping con gurations of sensors to actions, and these to system's responses. This abstract setting is shown at work in two elds: direct manipulation of an iconic interface and recognition of emotional moods from posture analysis.