Competitive Evaluation of Commercially Available Speech Recognizers in Multiple Languages
Susanne Burger, Zachary A. Sloane, Jie Chi Yang · 2006
Recent improvements in speech recognition technology have resulted in products that can now demonstrate commercial value in a variety of applications.Many vendors are marketing products which combine ASR applications including continuous dictation, command-and-control interfaces, and transcription of recorded speech at an accuracy of 98%.In this study, we measured the accuracy of certain commercially available desktop speech recognition engines in multiple languages.Using word error rate as a benchmark, this work compares recognition accuracy across eight languages and the products of three manufacturers.Results show that two systems performed almost the same while a third system recognized at lower accuracy, although none of the systems reached the claimed accuracy.Read speech was recognized better than spontaneous speech.The systems for US-English, Japanese and Spanish showed higher accuracy than the systems for UK-English, German, French and Chinese.