Approaches to black box MT evaluation
John Sampson White · 1995
Abstract. In the course of four evaluations in the Advanced Research Projects Agency Machine Translation series, evaluation methods have evolved for measuring the core components of a diverse set of systems. This paper describes the methodologies in terms of the most recent evaluation of research and production MT systems, and discusses indications of ways to improve the focus and portability of the evaluation. 0. Introduction. Over the past four years, a set of evaluation methodologies have evolved within the MT initiative of the