BEER 1.1: ILLC UvA submission to metrics and tuning task
Miloš Stanojević, Khalil Sima’an · 2015
We describe the submissions of ILLC UvA to the metrics and tuning tasks on WMT15.Both submissions are based on the BEER evaluation metric originally presented on WMT14 (Stanojević and Sima'an, 2014a).The main changes introduced this year are: (i) extending the learning-to-rank trained sentence level metric to the corpus level (but still decomposable to sentence level), (ii) incorporating syntactic ingredients based on dependency trees, and (iii) a technique for finding parameters of BEER that avoid "gaming of the metric" during tuning.