On the Use of Speech and Face Information for Identity Verification
Conrad Sanderson, Kuldip K. Paliwal · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2004
(INITIAL VERSION: SEPTEMBER 2002) Abstract. This report first provides a review of important concepts in the field of information fusion, followed by a review of important milestones in audio-visual person identification and verification. Several recent adaptive and non-adaptive techniques for reaching the verification decision (i.e., to accept or reject the claimant), based on speech and face information, are then evaluated in clean and noisy audio conditions on a common database; it is shown that in clean conditions most of the non-adaptive approaches provide similar performance and in noisy conditions most exhibit a severe deterioration in performance; it is also shown that current adaptive approaches are either inadequate or utilize restrictive assumptions. A new category of classifiers is then introduced, where the decision boundary is fixed but constructed to take into account how the distributions of opinions are likely to change due to noisy conditions; compared to a previously proposed adaptive approach, the proposed classifiers do not make a direct assumption about the type of noise that causes the mismatch between training and testing conditions. This report is an extended and revised version of [60]. Keywords: biometrics, information fusion, identity verification, multi-modal, noise resistance. 2 IDIAP–RR 04-10