Self-supervised flow field decoupling for Controllable face reenactment
Xianwei Kong, Shengwu Xiong · Journal of Physics Conference Series · 2022
Abstract Face reenactment is a face image generation method. Its main task is to generate a new image given a source image and a driving image, which has the facial motion information of the driving image while retaining the content information of the source image. Existing flow-based approaches have demonstrated high-quality results, but these works regard the head movement as a whole, and cannot achieve more flexible movement control, and often suffer from the loss of identity information. In this paper, we propose a novel Controllable multi-identity face reenactment(CFReenet), which uses the prior information of facial motion to decompose the movement as two parts of pose and expression and use the curriculum strategy to decouple movement and identity information and better maintain identity information. The experimental results demonstrate the effectiveness of our method.