Visual speech and coarticulation effects
Helga Bothe, Frauke Rieger · IEEE International Conference on Acoustics Speech and Signal Processing · 1993
The state of the art of a computer animation program showing realistic movements of an abstracted speaker's face is presented. For this purpose, video tapes with prototypic speakers have been recorded and analyzed in order to investigate the fundamental correlation between phonetic sequences of given German texts and the corresponding visual movements of articulation. Considering coarticulation effects, a 2-D-motion model was set up on a commercial PC using a set of 38 key pictures and calculating interim frames. The coordinated movements of the visible speech synthesis cover the lips, the teeth, and the tip of the tongue. The possible text input is based on an open vocabulary. The program is designed to be a training aid for lip reading for hearing-impaired people.>