A Topic-based Dynamic Clustering Algorithm for Text Stream
Y. Rao, X.J. Li · Advances in intelligent systems research/Advances in Intelligent Systems Research · 2015
In order to provide real-time early warning from the public sentiment information in social network for making decision, a topic-based dynamic clustering for text stream (TBDC4TS) algorithm is proposed to cluster the text stream, which is formed by web crawler to continuously grab the web pages.The sliding time window (SWt) can be used to split the text stream into continuous segmentation, which includes a set of web news' pages related to the velocity of stream and the size of sliding window.Furthermore, a multi-phase cluster method in TBDC4TS is used to merge the micro-cluster in each sliding window and Macro-cluster in single-pass engine together.The results of experiments, used 2650 web news pages to form a simulate text stream by web crawler, show that the TBDC4TS algorithm has 22.8 times executing efficiency and the higher clustering qualify, such as precision and recall rate, than Singlepass.