Combining Multiple Chinese Word Segmentation Results for Statistical Machine Translation
Tiejun Zhao · Zhongwen xinxi xuebao · 2010
In Chinese-English statistical machine translation(SMT),Chinese texts usually demands Chinese word segmentation(CWS) to identify the words in a sentence.However,CWS is not developed for SMT and hence its results are not necessarily optimal for SMT.In recent years,many investigations have been performed concerning making CWS suitable for SMT,but we explore it from another direction.In this paper,our basic idea is to use multiple CWS results as additional language knowledge source and we present a simple and effective approach to use multiple CWS results for SMT.We also give experiment results over a series of combining strategy,and the best result shows 1.89 percentage gain in BLEU points over a start-of-the-art SMT system.