Co-occurrence Degree Based Word Alignment in Statistical Machine Translation
Yating Yang, Chenggang Mi, Lei Wang, Xiaoli Li · The Open Automation and Control Systems Journal · 2014
To alleviate the data sparseness problem during word alignment, we propose a word alignment method based on word co-occurrence degree.In this paper, we propose a new method to get the statistical information from word cooccurrence.We combine the co-occurrence counts and the fuzzy co-occurrence weights as word co-occurrence degree.Fuzzy co-occurrence weights can be obtained by searching for fuzzy co-occurrence word pairs and computing differences of length between current word and other words in fuzzy co-occurrence word pairs.Experiments show that the quality of word alignment and the translation performance both improved.