Computer-Aided Specification of Quality Models for Machine Translation Evaluation
Eduard H. Hovy, Margaret King, Andréi Popescu-Belis · 2002
This article describes the principles and mechanism of an integrative effort in machine translation (MT) evaluation.Building upon previous standardization initiatives, above all ISO/IEC 9126, 14598 and EAGLES, we attempt to classify into a coherent taxonomy most of the characteristics, attributes and metrics that have been proposed for MT evaluation.The main articulation of this flexible framework is the link between a taxonomy that helps evaluators define a context of use for the evaluated software, and a taxonomy of the quality characteristics and associated metrics.The article explains the theoretical grounds of this articulation, along with an overview of the taxonomies in their present state, and a perspective on ongoing work in MT evaluation standardization.