Natural and Intuitive Multimodal Dialogue for In-Car Applications: The Sammie System
Tilman Becker, Nate Blaylock, Ciprian Gerstenberger, Ivana Kruijff‐Korbayová, Andreas Korthauer, Manfred Pinkal, Michael Pitz, Peter Poller, Jan Schehl · 2006
We present SAMMIE, a laboratory demonstrator of an in-car showcase of a multimodal dialogue system developed in the TALK project 5 in cooperation between DFKI/USAAR/BOSCH/BMW, to show natural, intuitive mixed-initiative interaction, with particular emphasis on multimodal turn-planning and natural language generation. SAM-MIE currently supports speech-centered multimodal access for the driver to a MP3-player application including search and browsing, as well as composition and modification of playlists. Our approach to dialogue modeling is based on collaborative problem solving integrated with an extended Information State Update paradigm. A formal usability evaluation of a first baseline system of SAMMIE by naive users in a simulated environment yielded positive results, and the improved final version will be integrated in a BMW research car. 1