Study of Chinese SMS Text Similarity Based on Semantic Information
Fan Yu-hong · Jisuanji gongcheng · 2012
This paper analyzes the semantic information of characteristic words in Chinese SMS text based on the traditional model TF-ID,and proposes a Chinese SMS text similarity measurement method.It preprocesses the SMS text,calculates TF-IDF values of each word,and selects high TF-IDF value of words as Key words.With word vector similarity of the Vector Space Model(VSM),combined with the word similarity weighted,it gives two SMS text similarity computing method.Experimental results show that the F-measure of this method is better than TF-IDF and word semantic similarity algorithm.