Definition of an evaluation grid for term-extraction software
Marie-Claude L’Homme, Loubna Benali, Claudine Bertrand, Patricia Lauduique · Terminology International Journal of Theoretical and Applied Issues in Specialized Communication · 1996
This paper examines evaluation criteria for term-extraction software. These tools have gained popularity over the past few years, but they come in all sorts of structures and their performance cannot be compared (qualitatively) to that of humans performing the same task. The lists obtained after an automated extraction must always be filtered by users. The evaluation form proposed here consists of a certain number of preprocessing criteria (such as the language analyzed by the software, identification strategies used, etc.) and a postprocessing criterion (performance of software) that users must take into account before they start using such systems. Each criterion is defined and illustrated with examples. Commercial tools have also been tested.