Entropy and Standard Entropy of Random Variable
Xueqin Wang · Journal of Sanmenxia Polytechnic · 2003
This paper discusses the relationship among entropy, standard entropy and standard difference and concludes that the entropy of discrete random variable is equal to the standard entropy, not related to the standard difference; about continuous random variable ξ(ξis the standard random variable of ξ), the entropy H(ξ) is equal to its standard entropy H(ξ)plus the logarithm σ of the standard difference. Therefore, the essential differences between the discrete random variable and continuous random variable are that there is no relation between uncertainty and discreteness of discrete random variable, and there is a logarithm relation between the uncertainty and discreteness (standard difference) of the continuous random variable.