Predicting Visual Intelligibility Gain in the SynFace Application
Petra Hagström · 2009
When the acoustic signal is weak or disturbed, normal hearing people as well as hearing impaired make use of visual information as a support for their interpretation of the speech. Thus, a talking head could be of great support for the hearing impaired when engaged in speech activities where no visual information is available, such as a telephone conversation or when listening to an audio book. SynFace, a talking head developed at the Royal Institute of Technology, is an application where the lip movements are driven by the acoustic signal and synchronized with the speech. Thus, it could be a valuable support since it provides sufficient visual information. The purpose of this project is to find an error metric that could be used to predict the visual intelligibility gain when using the SynFace application. The metric is based on visual similarity among Swedish vowels and consonants, respectively. The