Evaluating Entity Annotators Using GERBIL
Ricardo Usbeck, Michael Röder, Axel-Cyrille Ngonga Ngomo · Lecture notes in computer science · 2015
The need to bridge between the unstructured data on the Document Web and the structured data on the Web of Data has led to the development of a considerable number of annotation tools. However, these tools are hard to compare due to the diversity of data sets and measures used for evaluation. We will demonstrate GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, fine-grained and uniform evaluation of annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.