The IntelliMedia WorkBench - an environment for building multimodal systems
Tom Brøndsted, Lars Bo Larsen, Michael J. Manthey, Paul Mc Kevitt, Thomas Baltzer Moeslund, Kristan G. Olesen · 1998
e workbench A very open architecture has been chosen to allow for easy integration of new modules. The central module is a blackboard, which stores information about the system's current state, history, etc. All modules communicate through the exchange of semantic frames with other modules or the blackboard. The process synchronisation and intercommunication is based on the DACS IPC platform, developed by the SFB360 project at Bielefeld university [Fink et al 1996]. DACS allows the modules to be distributed across a number of servers. The architecture is shown in figure 1, and the physical layout in figure 2. Figure 1 shows the blackboard as the central element with a number of modules around. Presently modules for speech recognition, parsing, speech synthesis, 2D visual gesture recognition and a laser pointing device are integrated into the application described below. Furthermore a sound source locator (a microphone array) and a machine learning system [Manthey 19