Multimodal Dialogue Systems with InproTKs and Venice
Casey Kennington, Spyridon Kousidis, David Schlangen · PUB – Publications at Bielefeld University (Bielefeld University) · 2014
We present extensions of the incremental processing toolkit INPROTK which, together with our networking adaptors (Venice), make it possible to plug in sensors and to achieve situated, real-time, multimodal dialogue.We also describe a new module which enables the use in IN-PROTK of the Google Web Speech API, which offers speech recognition with a very large vocabulary and a wide choice of languages.We illustrate the use of these extensions with a real-time multimodal reference resolution demo, which we make freely available, together with the toolkit itself.