User behaviour in Multimodal Interaction
E.A. den Os, Lou Boves · 2005
In this paper we investigate whether the behaviour of non-expert subjects who interact with a fully implemented multimodal application is comparable to the behaviours observed with Wizard-of-Oz systems. To that end we have implemented in the COMIC project an application for bathroom design that accepts speech and pen input, and provides output in the form of stylized drawing and text on a screen, combined with a naturalistic talking head. In addition, we draw on data obtained in the MUST 2 project, also with a fully implemented system. We find comparable behaviour in some respects, but also different behaviours, which can be linked to differences in the functionality of the systems and the complexity and nature of the tasks.