A new GA optimised Reliability Ratio based integration weight estimation scheme for decision fusion Audio-Visual Speech Recognition
Rajesh D. Rajavel, Puthumangalathu Savithri Sathidevi · International Journal of Signal and Imaging Systems Engineering · 2011
Audio-Visual Speech Recognition (AVSR) using acoustic and visual signals of speech have received attention recently because of its robustness in noisy environments. An important issue in decision fusion AVSR systems is the determination of appropriate integration weight for better performance. A new Genetic Algorithm (GA) based scheme to obtain an appropriate integration weight is proposed here. The performance of the proposed scheme is demonstrated for commonly used mobile functions isolated word recognition via multi-speaker database experiment. The results show that the proposed scheme improves robust recognition accuracy over conventional unimodal systems and other related bimodal systems, namely, Reliability ratio and Neural Network based AVSR systems.