Visual Design of Multimodal Interaction - Bridging the Gap between Interaction Designers and Developers
Werner A. König, Roman Rädle, Harald Reiterer · KOPS (University of Konstanz) · 2009
In contrast to the pioneers of multimodal interaction e.g. Richard Bolt in the late seventies, today’s researchers can benefit of a wide variety of existing interaction techniques, devices and frameworks. Although these tools are available, the usage of them is still a great challenge particularly in terms of usability. A major issue results from the trade-off between the functionality of the system and the simplicity of use. We introduce a novel visual user interface concept which is especially designed to ease the design and development of post-WIMP user interfaces including multimodal interaction. It provides an integrated design environment for our interaction library “Squidy ” based on high-level visual data flow programming combined with zoomable user interface concepts. The user interface offers