MaxEnt Upper Bounds for the Differential Entropy of Univariate Continuous Distributions
Frank Nielsen, Richard Nock · IEEE Signal Processing Letters · 2017
We present a series of closed-form upper bounds of the differential entropy of univariate continuous distributions based on the maximum entropy principle. We apply those bounds to Gaussian mixture models, and study their tightness properties.