Using ontologies in design of multimodal user interfaces
Željko Obrenović, Dušan Starčević, Vladan Devedžić · TU/e Research Portal · 2003
In this paper we introduce an ontology-based approach to the design of multimodal user interfaces. The main benefit of our approach is the unified ontology of multimodal interaction, where we have integrated the knowledge and common concepts from different domains of multimodal interaction in a uniform way. The unified ontology of multimodal interaction can be viewed as a tool that a designer of user interfaces can use to see relations between his design and various human factors. Using this ontology we have explored novel design approaches in order to provide means for abstract definition of a human-computer interaction at different levels. We have also integrated the ontology with existing user interface platforms, what allows mapping of high-level concepts from the ontology to primitives in a user interface platform, and evaluation existing user interfaces in order to see what perceptual or cognitive effects they produce.