Sentence Similarity Measurement Based on Shallow Parsing
Lin Li, Yiming Zhou, Boqiu Yuan, Jun Wang, Xia Hu · 2009
The paper proposes a novel method to determine sentence similarities. First two compared sentences are parsed by shallow-parsing and all noun phrases, verb phrases and preposition phrases of each sentence are extracted. Then the similarity between each kind of phrases is calculated based on a semantic vector method. The overall sentence similarity is defined as a combination of semantic similarities of the three kinds of phrases. Experiments show that the proposed method has a high performance in F-measure (81.6%) and Recall (97.4%).