Some Questions and Algorithm of Multimodal Integration
Yamin Sun · Jisuanji gongcheng · 2004
The aim of multimodal interface is to get the users intent by more than one sense and action modals and to make the interaction of human an computer more natural and more effective. The key of multimodal interface is multimodal integration. In this article an integration algorithm based on task oriented and hierarchical multimodal integration modal is carried out. In this algorithm there are three questions: representation of programme state, desig of task structure and representation of the relativity of interaction primitive to be discussed. At last the algorithm is given.