MapReduce-based Bayesian anti-spam filtering mechanism
Lei Shi · Journal of Computer Applications · 2011
The Bayesian anti-spam filter has strong classification capacity and high accuracy,but the mail training and learning at early stage consume mass system and network resources and affect system efficiency.A MapReduce-based Bayesian anti-spam filtering mechanism was proposed,which first improved the traditional Bayesian filtering technique,and then optimized the mail training and learning by taking advantage of mass data processing of MapReduce.The experimental results show that,compared with the traditional Bayesian filtering technique,K-Nearest Neighbor(KNN) and Support Vector Machine(SVM) algorithms,the MapReduce-based Bayesian anti-spam filtering mechanism performs better in recall,precision and accuracy,reduces the cost of mail learning and classifying and improves the system efficiency.