Phrase-based Parallel Fragments Extraction from Comparable Corpora
Xiaoyin Fu, Wei Wei, Shixiang Lü, Zhenbiao Chen, Bo Xu · 2015
We present a phrase-based method to ex-tract parallel fragments from the compa-rable corpora. We do this by introducing a force decoder based on the hierarchical phrase-based (HPB) translation model to detect the alignments in comparable sen-tence pairs. This method enables us to ex-tract useful training data for statistical ma-chine translation (SMT) system. We eval-uate our method by fragment detection and large-scale translation tasks, which show that our method can effectively extract par-allel fragments and improve the perfor-mance of the state-of-the-art SMT system. 1