EntropyEstimation: Estimation of Entropy and Related Quantities

Lijuan Cao, Michael Grabchak · 2014

Contains methods for the estimation of Shannon's entropy, variants of Renyi's entropy, mutual information, Kullback-Leibler divergence, and generalized Simpson's indices. The estimators used have a bias that decays exponentially fast.

Read the paper · More papers on PaperTik