Better statistical estimation can benefit all phrases in phrase-based statistical machine translation
Khalil Sima’an, Markos Mylonakis · 2008
The heuristic estimates of conditional phrase translation probabilities are based on frequency counts in a word-aligned parallel corpus. Earlier attempts at more principled estimation using Expectation-Maximization (EM) under perform this heuristic. This paper shows that a recently introduced novel estimator based on smoothing might provide a good alternative. Whenallphrasepairsare estimated (no length cut-off), this estimator slightly outperforms the heuristic estimator.