Japanese Phone Recognition using Lip Image Information
Takeshi Saitoh, Mitsugu Hisagi, Ryōsuke Konishi · 2007
This paper describes Japanese phone recognition for lip reading based on a novel feature called trajectory feature to obtain high recognition rate. Trajectory fea-ture is a time change of two mouth shape features ex-pressed as a two-dimensional trajectory of the lip mo-tion. The most similar trajectory in a database which is compared with the target trajectory by DP match-ing is selected as a result phone. Traditional researches concerned phone recognition experimented with only Japanese five vowels. In this paper, experiments were conducted for Japanese 45 phones with five person, and classified into five vowels and ten consonants, and recognition rate of 94.1 % and 28.9%, respectively, were obtained. 1