Subspace transmission: Desynchronized speech-gesture signals still get the message across
Carolin Kirchhof · Publikationen an der Universität Bielefeld (Universität Bielefeld) · 2016
Two sets of studies researched the perceptual integration of desynchronized speech and gesture in listeners.In the first set, participants rated how natural asynchronies in multimodal stimuli with varying face obscurity appeared to them, both with speech before and after the gesture for up to 600 ms.In the second set, participants were asked to re-synchronize speech and gesture with a slider.Both sets of studies show that the synchrony of the two modalities is far less significant in perception than was assumed a priori through the observation of production.Speech may precede or follow gesture by ±500 ms or more and listeners might not even notice.Strict speech-gesture synchrony appears to be a mere production phenomenon.