Online Topic Detection Algorithm for Internet News
Zhiyi Long · Jisuanji gongcheng · 2009
This paper analyses the Internet news reports and finds their characteristics such as redundancy, low centralization of the discussions and the topic drift.An Online Topic Detection(ODT) method for Internet is proposed.It defines the sub-topic to ignore the redundancies reports, presents the double-lays configuration for the low centralization of the discussions, and advances a topic tracking algorithm based on the sliding window.A topic detection system is build according to the method.The system is tested by the real data from the Internet.The results present that this method is better than the single-pass method for ODT.The CDet of the method is under 0.14.