DERIVING THE OPTIMAL MODALITY COMBINATION FOR SEARCHING IN MULTIDIMENSIONAL DATABASES
Myra P. van Esch-Bussemakers, Anita Cremers, Mark A. Neerincx, Astrif J. van der Flier · ICWI · 2003
The European MIAMM-project (Multidimensional Information Access using Multiple Modalities) develops new concepts and techniques for multimodal dialogs that allow for fast and natural mobile access to multimedia databases. In an experiment we investig ated different modality combinations (haptic-tactile, non-speech audio and a redundant combination) for conveying information on the size of a data-set. The results show that users perform better in the condition with redundant non-speech audio and haptic-tactile feedback and also prefer this condition. The knowledge gained in this experiment will be extended in the course of the MIAMM-project to possibly cover other contexts, tasks and to do testing in realistic environments.