Meteor++: Incorporating Copy Knowledge into Machine Translation Evaluation
Yinuo Guo, Chong Ruan, Junfeng Hu · 2018
In machine translation evaluation, a good candidate translation can be regarded as a paraphrase of the reference.We notice that some words are always copied during paraphrasing, which we call copy knowledge.Considering the stability of such knowledge, a good candidate translation should contain all these words appeared in the reference sentence.Therefore, in this participation of the WMT'2018 metrics shared task we introduce a simple statistical method for copy knowledge extraction, and incorporate it into Meteor metric, resulting in a new machine translation metric Meteor++.Our experiments show that Me-teor++ can nicely integrate copy knowledge and improve the performance significantly on WMT17 and WMT15 evaluation sets.