Linguistically Aware Coreference Evaluation Metrics
Chen Chen, Vincent Ng · 2013
Virtually all the commonly-used evalua-tion metrics for entity coreference reso-lution are linguistically agnostic, treating the mentions to be clustered as generic rather than linguistic objects. We argue that the performance of an entity coref-erence resolver cannot be accurately re-flected when it is evaluated using linguis-tically agnostic metrics. Consequently, we propose a framework for incorporating linguistic awareness into commonly-used coreference evaluation metrics. 1