TFIDF Algorithm Based on Information Gain and Information Entropy
Guangjun He · Jisuanji gongcheng · 2012
The classical Term Frequency and Inverse Documentation Frequency(TFIDF) algorithm neglects the proportion of distribution of terms in categories and between categories of the text collection.Aiming at this problem,this paper introduces the information entropy,and the TFIDF algorithm based on information gain(TFIDFIG) is improved.It proposes a TFIDF algorithm based on information gain and information entropy(TFIDFIGE).Experimental results show that the TFIDFIGE algorithm is more effective than the traditional algorithm,namely TFIDF,TFIDFIG,in terms of precision and recall.