InproTKs: A Toolkit for Incremental Situated Processing
Casey Kennington, Spyros Kousidis, David Schlangen · 2014
In order to process incremental situated dialogue, it is necessary to accept information from various sensors, each tracking, in real-time, different aspects of the physical situation.We present extensions of the incremental processing toolkit IN-PROTK which make it possible to plug in such multimodal sensors and to achieve situated, real-time dialogue.We also describe a new module which enables the use in INPROTK of the Google Web Speech API, which offers speech recognition with a very large vocabulary and a wide choice of languages.We illustrate the use of these extensions with a description of two systems handling different situated settings.