Human lips synchronisation in Autodesk Maya
Antonio Moura, Ingrida Mažonavičiūtė, João Ferreira Nunes, Justinas Grigaravicius · 2007
Realistic facial synthesis is one of the most fundamental problems in computer graphics and one of the most difficult. Human lips synchronization of the faces is very important part of this. In this paper it solves the issue of how to make human lips synchronization in one of the most popular 3D modelling software - Autodesk Maya. It is described an automatic way to analyse voice, using Adobe after effects and how the result interacts to Maya, but this way is still in progress, so voice is analyzed and classified manually. Using programming language of Maya - MEL (Maya Embedded Language) the recognized phonemes are associated with mouth positions to provide visemes for computer animation of speech. Different mouth positions are created using blend shape deformers, that let you to deform a surface into the shapes of other surfaces. Lip animation is facilitated by activating facial muscles and the jaw on the given facial model created specially for animation. Highspeed natural-looking synchronized lips animation is achieved. It is planed to model the expressive visual features of expressive speech. Informal user testing suggests that the addition of detailed internal mouth structures, such as the tongue, would improve the phrase recognition.