A new method for measuring uncertainty and fuzziness in rough set theory
Jiye Liang, Kwai‐Sang Chin, Chuangyin Dang, Richard C.M. Yam · International Journal of General Systems · 2002
Based on the complement behavior of information gain, a new definition of information entropy is proposed along with its justification in rough set theory. Some properties of this definition imply those of Shannon's entropy. Based on the new information entropy, conditional entropy and mutual information are then introduced and applied to knowledge bases. The new information entropy is proved to also be a fuzzy entropy.