Evaluating Machine Translation in Use: from Theory to Practice
Paula Estrella, Tony Hartley, Maghi King, Andréi Popescu-Belis · 2008
This tutorial offers an introduction to the field of Machine Translation evaluation, and in particular to FEMTI, the Framework for the Evaluation of Machine Translation in ISLE, which groups together a wide range of evaluation metrics, following a contextual evaluation approach. In a practical application of the framework, participants will be shown how to apply FEMTI to an operational example of MT use, in order to construct a well-motivated quality model. The results from the practical exercise will be compared, and a synthesis will be proposed in the end, explaining how feedback from the community can be input into FEMTI.