Performance estimation of speech recognition based on Perceptual Evaluation of Speech Quality and acoustic parameters under noisy and reverberant environments with Corpus and Environment for Noisy Speech RECognition 4
Takahiro Fukumori, Masato Nakayama, Takanobu Nishiura, Yoichi Yamashita · The Journal of the Acoustical Society of America · 2013
CENSREC-4 evaluation framework has been distributed for evaluating distant-talking speech under various noisy and reverberant environments. It however has not been evaluated how variable noisy and reverberant features in this contains. We thus try to evaluate CENSREC-4 with our designed noisy and reverberant criteria based on PESQ and acoustic parameters. We specifically focus on criteria to represent the difficulty of noisy and reverberant speech recognition, and also confirm why it is difficult to easily evaluate the recognition accuracy in a part of CENSREC-4 corpus with our proposed noisy and reverberant criteria. We first designed the noisy and reverberant criteria using the relationship among the D value, the PESQ, and the ASR performance. We then tried to estimate the recognition accuracy in various noisy and reverberant environments with CENSREC-4. We carried out evaluation experiments to confirm the difficulty to easily evaluate the recognition accuracy in a part of CENSREC-4 courpus0. As a result of evaluation experiments, we confirmed that it was difficult to estimate the accuracy of noisy and reverberant speech recognition in heavy noisy and reverberant environment with CENSREC-4. We therefore confirmed that CENSREC-4 contained very challenging and variable noisy and reverberant data.