The PLUG Link Annotator – interactive construction of data from parallel corpora
Magnus Merkel, Mikael Andersson, Lars Ahrenberg · 2002
In this paper an approach of using gold standards to evaluate word alignment systems is described. To make the process of creating gold standards easier, an interactive tool called the PLUG Link Annotator is presented along with the Link Scorer, which automatically evaluates the output from a word alignment system against the gold standard. It is argued that using reference data in this manner has several advantages, the most important being consistency in evaluation criteria as well as savings in time, due to the fact that the reference data only need to be constructed once, but can be applied many times.