Duluth : Measuring Cross-Level Semantic Similarity with First and Second Order Dictionary Overlaps
Ted Pedersen · 2014
This paper describes the Duluth systems that participated in the Cross–Level Se-mantic Similarity task of SemEval–2014. These three systems were all unsupervised and relied on a dictionary melded together from various sources, and used first–order (Lesk) and second–order (Vector) over-laps to measure similarity. The first–order overlaps fared well according to Spear-man’s correlation (top 5) but less so rela-tive to Pearson’s. Most systems performed at comparable levels for both Spearman’s and Pearson’s measure, which suggests the Duluth approach is potentially unique among the participating systems. 1