Space Tentacles - Integrating Multimodal Input into a VR Adventure Game
Chris Zimmerer, Martin Fischbach, Marc Erich Latoschik · 2018
Multimodal interfaces for Virtual Reality (VR), e.g., based on speech and gesture input/output (I/O), often exhibit complex system architectures. Tight couplings between the required I/O processing stages and the underlying scene representation and the simulator system's flow-of-control tend to result in high development and maintainability costs. This paper presents a maintainable solution for realizing such interfaces by means of a cherry-picking approach. A reusable multimodal I/O processing platform is combined with the simulation and rendering capabilities of the Unity game engine, allowing to exploit the game engine's superior API usability and tool support. The approach is illustrated based on the development of a multimodal VR adventure game called Space Tentacles.