Multimodal Communication in Face-to-Face Computer-Mediated Conversations
Max M. Louwerse, Nick Benesh, Mohammed Ehsan Hoque, Patrick P. J. M. H. Jeuniaux, Gwyneth A. Lewis, Jie Ying Wu, Megan Zirnstein · eScholarship (California Digital Library) · 2007
Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture.Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication exist.As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coordination task.The study thereby sheds light on multimodal communication in humans and gives guidelines for the development of embodied conversational agents.