Application of 3D Morphable Models to faces in video images
R.T.A. van Rootseler, Lieuwe Jan Spreeuwers, Raymond N. J. Veldhuis · University of Twente Research Information · 2011
The 3D Morphable Face Model (3DMM) has been used for over a decade for creating 3D models from single images of faces. This model is based on a PCA model of the 3D shape and texture generated from a limited number of 3D scans. The goal of fitting a 3DMM to an image is to find the model coefficients, the lighting and other imaging variables from which we can remodel that image as accurately as possible. These coefficients can without further processing be used in verification and recognition experiments. In this paper, we investigate the potential benefits of using multiple images from the same person to fit a 3DMM. Lighting and imaging variables can differ from image to image, but the PCA coefficients will remain the same, assuming no change in expression between the images. We expect using multiple images could result in a more accurate fit.