The mutual information as a measure of statistical dependence
Georges A. Darbellay · 2002
The mutual information I, if appropriately normalised, can serve as a measure of correlation. In encompassing nonlinear dependences, it generalises the classical measures of linear correlation. An efficient nonparametric estimator of I can be derived from Dobrushin's (1963) information theorem.