Evaluation of Word Alignment Systems
Lars Ahrenberg, Magnus Merkel, Anna Sågvall Hein, Jörg Tiedemann · 2000
Recent years have seen a few serious attempts to develop methods and measures for the evaluation of word alignment systems, notably the Blinker project (Melamed, 1998) and the ARCADE project (Véronis and Langlais, forthcoming).In this paper we discuss different approaches to the problem and report on results from a project where two word alignment systems have been evaluated.These results include methods and tools for the generation of reference data and a set of measures for system performance.We note that the selection and sampling of reference data can have a great impact on scoring results.