Analysis by Synthesis of Embodied Communication via VirtualActor with a Nodding Response Model(Mechanical Systems)
Yoshihiro SEJIMA, Tomio Watanabe, Michiya Yamamoto · TRANSACTIONS OF THE JAPAN SOCIETY OF MECHANICAL ENGINEERS Series C · 2009
We have already developed an embodied virtual communication system (EVCOS) for human interaction analysis by synthesis. This system provides two remote talkers with a communication environment in which embodied interaction is shared by VirtualActors (VAs) including the talkers themselves through a virtual face-to-face scene. We confirmed the importance of head movements including nodding in embodied communication by using this system. In this paper, we develop the EVCOS with a speech-driven nodding response model for the analysis by synthesis of embodied communication under the promoted condition of superimposed nodding responses in a virtual space. By using the system, we perform experiments for the effects of superimposed nodding responses by the sensory evaluation and the voice-motion analysis by superimposing nodding responses on VA by the nodding response model. It is found that the cross-correlation between the talker's voice and the listener's head motion in the inconsistently activated condition increases at a significance level of 1% compared to that observed under normal condition. The result demonstrates that the system with the model promotes embodied interaction.