A novel approach for classifying continuous speech into visible mouth-shape related classes
Simon Luo, Robin W. King · 2002
The paper describes a novel approach for classifying continuous speech into visible mouth-shape related classes (called visemes). The selection and comparison of various acoustic speech features and the use of context information in the classification are addressed. Continuous speech is classified into 9 visible mouth-shape related classes on an acoustic frame basis. Some mouth-shape related acoustic speech signal features are selected as the input to a classifier constructed with recurrent neural network (RNN). 304 training sentences and 88 testing sentences are chosen from DARPA TIMIT continuous speech database. The average viseme recognition rate for the test set reaches 84.7% on frame level, which is a quite promising result considering that the test is applied on continuous multi-speakers and large vocabulary speech.>