Use of Vertical Face Profiles for Text Dependent Audio-Visual Biometric Person Authentication.
Vinod Pathangay, B. Yegnanarayana · Indian Conference on Computer Vision, Graphics and Image Processing · 2002
In this paper, a technique is proposed for text dependent audio-visual biometric person authentication using Dynamic Time Warping (DTW). A combination of features derived from video and audio is used as a representation of the utterance. The use of mid-face vertical intensity profiles as a representation of facial movements associated with the utterance is proposed. The time varying profiles are extracted from the video sequence after detecting the face using a motion guided template matching technique. The visual feature is combined with Linear Prediction Cepstral Coefficients (LPCC) extracted from the speech waveform to obtain a temporally synchronous joint audio-visual feature. The joint audio-visual feature sequences are matched using the DTW algorithm to obtain the distances between the test and the reference utterances. The performance of the system is evaluated for a database of 25 speakers, and the results are discussed.