Research on Spam Filtering Based on Semantic Understanding
Shi Hui · Zhongwen xinxi xuebao · 2008
The accuracy of the Chinese Word Segmentation is crucial to Chinese spam filtering.After analyzing the techniques of the statistical-based and rule-based spam filtering,this paper designs a spam filtering model based on semantic understanding,which combines the research of semantic processing with the algorithm of spam filtering.It also proposes an improved word segmentation algorithm,which improves the efficiency and the accuracy of the word segmentation and the ability to identify the out-of-vocabulary(OOV) words.Finally,the experimental data indicates that the design of the spam filtering model based on the semantic,to a certain extent,resolves the issue of the words of splitting encountered in the spam filtering and the OOV words after in word segmentation.