Mobile Architecture for Distributed Multimodal Dialogues

Markku Turunen, Esa-Pekka Salonen, Jaakko Hakulinen, Juuso Kanner, Anssi Kainulainen · 2005

There is an increasing need for mobile spoken dialogue systems. Mobile devices, such as smartphones and personal digital assistants, can be used to implement efficient speech-based and multimodal interfaces. Currently, the development of such applications lacks suitable tools. We introduce general system architecture for mobile spoken dialogue systems. The architecture is a mobile version of the existing Jaspis architecture. The architecture makes it possible to implement distributed dialogue systems using compact software agents in flexible ways both on the server and mobile devices. We present how an existing server-based timetable application is turned into a multimodal mobile application. The server handles the overall coordination of the dialogue by generating dialogue task descriptions using VoiceXML, and the mobile device realizes the dialogue descriptions with available resources. 1.

Read the paper · More papers on PaperTik