Extensible middleware framework for multimodal interfaces in distributed environments

Vitor Fernandes, Tiago Guerreiro, Bruno Martins Araújo, Joaquim Armando Jorge, João Madeiras Pereira · 2007

We present a framework to manage multimodal applications and interfaces in a reusable and extensible manner. We achieve this by focusing the architecture both on applications' needs and devices' capabilities. One particular domain we want to approach is collaborative environments where several modalities and applications make it necessary to provide for an extensible system combining diverse components across heterogeneous platforms on-the-fly. This paper describes the proposed framework and its main contributions in the context of an architectural application scenario. We demonstrate how to connect different non-conventional applications and input modalities around an immersive environment (tiled display wall).

Read the paper · More papers on PaperTik