Comparison of the ITU-t p.85 standard to other methods for the evaluation of text-to-speech systems
Dmitry Sityaev, K.M. Knill, Tina Burrows · 2006
Evaluation of TTS systems is essential to assess performance. The ITU-T P.85 standard was introduced in 1994 to assess the overall quality of speech synthesis systems. However it has not been widely accepted or used. This paper compares the ITU test to more commonly used tests for intelligibility (semantically unpredictable sentences (SUS)) and naturalness (mean opinion score based). The aim of this research was to determine if the ITU test can provide a better performance measure and/or supplementary information to help evaluate TTS systems. Index Terms: speech synthesis, evaluation