Speaker independent bimodal phonetic recognition experiments
Piero Cosi, Emanuela Magno Caldognetto, Franco Ferrero, M. Dugatto, Kyriaki Vagges · 2002
A speaker independent bimodal phonetic classification experiment regarding Italian plosive consonants is described. The phonetic classification scheme is based an a feedforward recurrent back-propagation neural network working on audio and visual information. The speech signal is processed by an auditory model producing spectral-like parameters, while the visual signal is processed by specialized hardware, called ELITE, computing lip and jaw kinematics parameters.