Non-Rigid Registration of a Human Face from Images from a Stereo Camera
A. D. Borisov, Сергей Дмитриевич Махортов · PROGRAMMNAYA INGENERIA · 2023
Capturing the facial expressions of an actor on the set to further transfer the scene to the digital space has become one of the most important tasks in the field of computer graphics. Most of the methods for solving this problem have a lower quality of reconstruction in comparison with the capture, which is carried out in videogrammetric installations. The reason is the inability to calculate high-quality three-dimensional scanned copies ("scans"). This article highlights the problematic issues of existing approaches and proposes a solution for capturing an actors facial expressions from images from a helmets stereo camera, which is comparable to stationary capture. To obtain this level of accuracy, it is proposed to use a local deformation model based on the geometries of key facial expressions, as well as stereo restriction, instead of explicitly calculating a 3D scan.