Multiple-Resource Theory as a Basis for Multimodal Interface Design: Success Stories, Qualifications, and Research Needs
Nadine B. Sarter · Oxford University Press eBooks · 2006
To date, the design of most multimodal displays appears to have been based—implicitly or explicitly—on the original version of Christopher Wickens' multiple-resource theory (MRT). Based on MRT, the concurrent performance of multiple tasks should benefit to the extent that information related to these tasks is presented in different modalities and thus resource competition is reduced. Although the mechanisms underlying improved time-sharing with cross-modal task and information presentation continue to be a matter of research and debate, the phenomenon itself has been confirmed and exploited in a number of research and development efforts. This chapter presents examples of the successful implementation of multimodal interfaces in support of concurrent task performance and information processing. It describes additional benefits of distributing information across sensory channels, including redundancy, complementarity, and substitution. Finally, critical research needs in the area of multimodal information processing and interface design are discussed.