Research on Micro-blog short text similarity and its application in Micro-blog topic detection
Huang Xian-yin · Jisuanji gongcheng yu sheji · 2015
For the inaccuracy problem of Micro-blog short text similarity calculation caused by sparse features,a method of Micro-blog short text similarity based on multiple views was proposed.Common blocks between short texts were found according to the same word in form or the similar word in meaning,and short text semantic similarity model based on common block sequence was newly established by combining the total number of words within common blocks with order between common blocks.The creating time of Micro-blog short texts and the structured information such as forwarding and commenting were used to revise short text semantic similarity model to construct a novel method of Micro-blog short text similarity,commonly measuring the similarity between Micro-blog short texts.The algorithm was combined with Single-Pass clustering algorithm to detect Microblog topics.Experimental results show that when applying the method into Micro-blog topic detection,the average missing rate and false detection rate of topic discovery were effectively reduced,improving the quality of topic discovery.