Improvements in Dynamic Programming Beam Search for Phrase-based Statistical Machine Translation
Richard Zens, Hermann Ney · 2008
Search is a central component of any statistical ma-chine translation system. We describe the search for phrase-based SMT in detail and show its importance for achieving good translation quality. We introduce an explicit distinction between reordering and lexical hypotheses and organize the pruning accordingly. We show that for the large Chinese-English NIST task al-ready a small number of lexical alternatives is sufficient, whereas a large number of reordering hypotheses is re-quired to achieve good translation quality. The result-ing system compares favorably with the current state-of-the-art, in particular we perform a comparison with cube pruning as well as with Moses. 1.