A Baseline for ViCo Conversational Head Generation Challenge
Meng Liu, Shuyan Zhai, Yongqiang Li, Weili Guan, Liqiang Nie · Proceedings of the 30th ACM International Conference on Multimedia · 2022
ViCo conversational head generation challenge is organized in conjunction with ACM Multimedia 2022. The challenge includes two tasks: 1) generating a vivid talking head according to a reference image and driving audio, and 2) synthesizing a listening head conditioned on the reference image and speaker's behaviors. For talking head generation, we design a three-stage method to generate high-quality and lip-sync talking head videos with natural head poses, which wins 3rd place and People's Selection Award. On the listening head generation track, we adopt MakeItTalk to generate vivid head movements of listeners, which achieves 2nd place in the competition.