Code-Switch Language Model with Inversion Constraints for Mixed Language Speech Recognition
Ying Li, Pascale Fung · 2012
We propose a first ever code-switch language model for mixed language speech recognition that incorporates syntactic constraints by a code-switch boundary prediction model, a code-switch translation model, and a reconstruction model. A WFST-based decoder then recognizes speech by combining an acoustic model, a pronunciation model and the code-switch language model in an integrated approach. Our proposed approach avoids making early decisions on code-switch boundaries and is therefore more robust than previous approaches. Our proposed system using the code-switch language model outperforms a baseline of interpolated language models by a statistically significant 0.91 % on a mixed language lecture speech corpus, and 1.25 % on a mixed language lunch conversation corpus. Our method also outperforms a language model that permits code-switch at all word boundaries by a statistically significant 1.35 % on the lecture speech corpus and 1.69 % on the lunch conversation corpus.