Improving Translation Quality by Discarding Most of the Phrasetable
Howard Johnson, Joel Martin, George Foster, Roland Kühn · Empirical Methods in Natural Language Processing · 2007
It is possible to reduce the bulk of phrasetables for Statistical Machine Translation using a technique based on the significance testing of phrase pair co-occurrence in the parallel corpus. The savings can be quite substantial (up to 90%) and cause no reduction in BLEU score. In some cases, an improvement in BLEU is obtained at the same time although the effect is less pronounced if state-of-the-art phrasetable smoothing is employed.