Word Space Models of Semantic Similarity and Relatedness
Yves Peirsman · Lirias · 2008
Abstract. Word Space Models provide a convenient way of modelling word mean-ing in terms of a word’s contexts in a corpus. This paper investigates the influence of the type of context features on the kind of semantic information that the models cap-ture. In particular, we make a distinction between semantic similarity and semantic relatedness. It is shown that the strictness of the context definition correlates with the models ’ ability to identify semantically similar words: syntactic approaches perform better than bag-of-word models, and small context windows are better than larger ones. For semantic relatedness, however, syntactic features and small context win-dows are at a clear disadvantage. Second-order bag-of-word models perform below average across the board.