Retrieving Compositional Documents Using Position-Sensitive Word Mover's Distance
Martin A. Trapp, Marcin Skowron, Dietmar Schabus · 2017
Retrieving similar compositional documents which consist of ranked sub-documents, such as threads of healthcare web fora containing community voted comments, has become increasingly important. However, approaches for this task have not exploited the semantic relationships between words so far and therefore do not use the effective generalization property present in semantic word embeddings. In this work, we propose an extension of the Word Mover's Distance for compositional documents consisting of ranked sub-documents. In particular, we derive a Position-sensitive Word Mover's Distance, which allows to retrieve compositional documents based on the semantic properties of their sub-documents. Additionally, we introduce a novel benchmark dataset for this task, to facilitate other researchers to work on this relevant problem. The results obtained on the novel dataset and on the well-known MovieLense dataset indicate that our approach is well suited for retrieving compositional documents. We conclude that incorporating semantic relations between words and sensitivity to the position and presentation bias is crucial for effective retrieval of such documents.