Word- and Sentence-level Confidence Measures for Machine Translation
Sylvain Raybaud, Caroline Lavecchia, David Langlois, Kamel Sma · 2009
A machine translated sentence is seldom completely correct. Confidence measures are designed to detect incorrect words, phrases or sentences, or to provide an estimation of the probability of correctness. In this article we describe several word- and sentence-level confidence measures relying on different features: mutual information between words, n-gram and backward n-gram language models, and linguistic features. We also try different combination of these measures. Their accuracy is evaluated on a classification task. We achieve 17 % error-rate (0.84 f-measure) on wordlevel and 31 % error-rate (0.71 f-measure) on sentence-level. 1