Taxonomy beats corpus in similarity identification, but does it matter?
Minh Le, Antske Fokkens · VU Research Portal · 2015
We present extensive evaluations comparing the performance of taxonomy-based and corpus-based approaches on SimLex- 999. The results confirm our hypothesis that taxonomy-based approaches are more suitable to identify similarity. We introduce two new measures of evaluation that show that all measures perform well on a coarse-grained evaluation and that it is not always clear which approach is most suitable when a similarity score is used as a threshold. This leads us to conclude that the inferior performance of corpus-based approaches may not (always) matter.