Research on Sudden Topic Detection Method for Microblog
Qiu Yunfei · 2012
Against the problem that Topic Detection and Tracking(TDT) can not deal with the short message texts on microblog which have strong randomness and non-standard terms effectively,a detecting method of sudden topics on microblog based on the dynamic sliding window is proposed.It includes the use of windows to extract the information with potential sudden,the use of normalized Term Frequeney-Inverse Doeument Frequeney(TF-IDF) function which is combined with semantic to compute feature weight and build Vector Space Model(VSM),the use of the main idea of Single-Pass clustering algorithm and then improving it in order to generate the final clustering.Experimental results show that the algorithm has an accurate result in sudden topic detection.