Evaluation Metrics for the Lexical Substitution Task
Sanaz Jabbari, Mark Hepple, Louise Guthrie · North American Chapter of the Association for Computational Linguistics · 2010
We identify some problems of the evaluation metrics used for the English Lexical Substitution Task of SemEval-2007, and propose alternative metrics that avoid these problems, which we hope will better guide the future development of lexical substitution systems.