Evaluating term extraction
Adeline Nazarenko, Haïfa Zargayouna · 2009
In contrast with other NLP tasks, only few and limited evaluation challenges have been carried out for terminology acquisition. It is nevertheless important to assess the progress made, the qual-ity and limitations of terminological tools. This paper argues that it is possible to define evalua-tion protocols for tasks as complex as computa-tional terminology. We focus on the core task of term extraction for which we propose evaluation metrics. We take into account the specificity of computational terminology, the complexity of its outputs, the application, the user’s role and the absence of well-established gold standard.