3D facial animation based on structural registration
Andréa Britto Mattos, Jesús Pascual Mena‐Chalco, R M Cesar-Jr · 2011
Abstract—This research aims to extend a facial animation and speech synthesis system that handles three-dimensional faces. This system manipulates realistic 3D models that can pronounce sentences in Portuguese and also allows tracking of the user’s movement in front of a camera, moving the model’s eyes according to the user’s face position. This project will contribute to the previous work, which has limitations on the models and facial expressions that are supported, in order to allow the use of generic models obtained via 3D scanners from real people. Therefore, this project consists on the 3D registration of two generic meshes, creating a correspondence between its vertices, so they can be easily interpolated and animated by the computer. To solve the problem of the registration of the faces, a new technique based on structural methods and currently applied to 2D images will be studied and adapted. The goal of this project is to extend this technique to three-dimensional models, evaluating the quality of this new approach.