Automatic word-level evaluation and error analysis of formant speech synthesis for Croatian
Sanja Seljan, Ivan Đunđer · 2013
In the paper the evaluation of formant speech synthesis for Croatian is conducted in four domains: hotel reservation, insurance, automobile industry and weather forecast. Human evaluation is performed in order to evaluate quality of speech according to criteria of sentence comprehensibility, word intelligibility and correctness of word pronunciation. Automatic evaluation is conducted using word error rate metric across four domains and across specific lexical units (names, numbers, dates, general and special terminology). Correlation between human evaluation and word error rate metric is given by Pearson's correlation. The results are discussed and suggestions for further research mentioned.