Facial motion analysis on monocular images for telecom applications : coupling expression and pose understanding
Andrés del Valle, Ana Cristina · 2003
Facial animation has become an active research topic in telecommunications. This field aims at replacing traditional communication systems by more human oriented solutions based on virtual reality technology. pastel-00000578, version 1- 26 Nov 2010 This thesis relates to a complete analysis/synthesis framework for facial rigid and non-rigid motion analysis from monocular video sequences. The obtained motion data are suitable to animate the realistic head clone of the analyzed speaker by generating face animation parameters. The core of the system is the rigid-motion tracking algorithm, which is able to provide the head pose parameters. The Kalman filter being used predicts the translation and rotation parameters, which are applied on the synthetic clone of the user. This process enables us to benefit from the synthetically generated virtual image by providing visual feedback for the analysis. This work exposes in detail novel techniques to study non-rigid facial motion coupled with head pose tracking. Specific feature analysis methods have been developed