Improvement of feature selection method in spam filtering
Qi Yuan Yu · Journal of Computer Applications · 2009
Spam filtering techniques based on content,especially feature selection algorithm was studied.Based on that,Mutual Information(MI) algorithm,combined with the feature of spam filtering,was analyzed and improved according to frequency,divergence,and concentration.Comparing with conventional mutual information algorithm,word frequency was introduced,and ratio of mutual information was used to evaluate the contribution to classifying provided by features.The improved formula and algorithm were given.At last,simulation test with real E-mail set,was conducted,which shows that the improved mutual information algorithm provides a better result for spam classification.