Lipreadable frame animation driven by speech parameters
Fabio Lavagetto, D. Arzerello, M. Caranzano · 2002
Two different approaches are here presented for converting speech into graphic animation, suitable to lipreading. Coarticulation modeling has been taken into account by means of an original algorithm for multistep statistical processing of digital speech in the cepstrum space. Two different visualization methods have been used, the first based on key reference pictures and the second based on a parametric flexible structure. Speech is converted, in real-time, into lipreadable visual animation by associating incoming acoustic frames with correspondent consistent graphic primitives, pictures or parameters, suitably visualized. Multiple fields of application are foreseen, mainly in rehabilitation, training, education and communication among hard of hearing people.>