Multimodal interaction with speech and physical touch interface in a media center application
Markku Turunen, Aleksi Kallinen, Iván Sanchéz Milara, Jukka P. Riekki, Juho Hella, Thomas Olsson, Aleksi Melto, Juha-Pekka Rajaniemi, Jaakko Hakulinen, Erno Mäkinen, Pellervo Valkama, Toni Miettinen, Mikko Pyykkönen, Timo Saloranta, Ekaterina Gilman, Roope Raisamo · 2009
We present a multimodal media center interface based on a novel combination of new modalities. The application is based on a combination of a large high-definition display and a mobile phone. Users can interact with the system using speech input (speech recognition), physical touch (touching physical icons with the mobile phone), and gestures. We present the key results from a laboratory experiment where user expectations and actual usage experiences are compared.