A Normal Law for the Plug-in Estimator of Entropy
Zhiyi Zhang, Xing Zhang · IEEE Transactions on Information Theory · 2011
This paper establishes a sufficient condition for the asymptotic normality of the plug-in estimator of Shannon's entropy defined on a countable alphabet. The sufficient condition covers a range of cases with countably infinite alphabets, for which no normality results were previously known.