Entropy of a variable slightly contaminated with another
Dinh-Tuan Pham · IEEE Signal Processing Letters · 2005
This work provides the expansion up to second order of the (differential) entropy of a random variable contaminated with another small variable. It is motivated by the blind source separation problem, in which it is of interest to consider the entropy of a mixture of random variables and study how it changes with respect to the mixing proportions.