A Comparative Study of MOS and PC Methods for Quality Evaluation of Text-to-Speech System in Mandarin
Jieping Xu · Microcomputer applications · 2006
The quality of four Text-to-Speech systems for mandarin was evaluated by using the methods of MOS (Mean Opinion Score) and PC (Paired Comparison). 17 juniors, including 10 boys and 7 girls, who speak mandarin very well joined the two tests. In MOS test, it includes six items---global impression, (listening)effort, (word)comprehension, speaking rate, prosody (stress, pause) and voice pleasantness. The test results for six parameters show that the coherence is the biggest between the global impression and the listening effort, the global impression and voice pleasant is the second. The test results of PC and MOS are good agreement, but PC is the simpler than MOS and the results more realizing.