Supporting the design of multimodal interactions: a case study in a 3D sculpture application

Daniela Gorski Trevisan, Felipe Carvalho, Alberto Barbosa Raposo, Carla Maria Dal Sasso Freitas, Luciana Nedel · 2010

This paper explores the idea of developing a hybrid user interface that was conceived from splitting a previous single desktop application for 3D volume sculpture into three different interactive environments (Wimp, Augmented Reality and Head-Mounted Immersive Virtual Reality). To achieve such goal we illustrated how the OpenInterface platform can facilitate the development process in order to allow several modalities for user interaction within and along the environments. Components for user interaction such as speech recognition and 3D commands were inserted into the multimodal platform as well as components for handle fusion of modalities.

Read the paper · More papers on PaperTik