Performance evaluation of word phrase and noun category language models for broadcast news speech recognition
Kazuyuki Takagi, Rei Oguro, Kenji Hashimoto, Kazuhiko Ozeki · 1998
This paper reports our work to improve a bigram language model for Japanese TV broadcast news speech recognition. First, frequent word strings were grouped into phrases in order that the phrases were added to the lexicon as new units of recognition. The test set perplexity was improved when frequent function word strings were used as additional recognition units. The speech recognition performance was improved both by grouping function word strings and by grouping compound nouns that were selected by word association ratio. Secondly, in order to alleviate the OOV problem related with nouns, we built and tested a language model that allows switching its noun lexicon according to the domain of the article to be recognized next. 1 INTRODUCTION The DARPA Hub-4 launched in 1995 is evaluating LVCSR systems to transcribe audio recordings of broadcast news [1]. The evaluation results have been updated annually [2]. The Japanese counterpart of HUB-4 broadcast news materials has been being deve...