The Model,Method and Instances of Multimodal User Interface
Dong Shihai · Acta Scicentiarum Naturalum Universitis Pekinesis · 1998
Multimodal Interfaces employ many kinds of interactive devices,such as speech input/output,pointing,gazetracking,and tactile and force feedback devices,make them cooperate with each other and take the advantage of their complementarily so as to facilitate the communication between user and computer,increase the efficiency of interaction,enhance its naturalness and ultimately make it possible for computer naive people to interact with computers using their everyday skills.This paper summarizes part of the work completed in the key project“Multimodal User Interface Research”supported by National Natural Science Foundations of China.First,we described its concepts,advantages and some terminologies,then proposed an Architecture and integration for Task Oriented Multimodality (ATOM) model,a Hierarchical Multimodal Interface Specification (HMIS) method,and a new interface paradigm (VIR Virtual Information Room).Finally,two case studies developed under way and conclusion are given.