Renyi entropy based divergence measures for ICA
Yan-Ling Bao, Hamid Krim · 2003
Information measures based on Renyi entropy provide a distance measure among a group of probability densities with tunable and flexible parameters to allow differentially granular differences in data. We interpret a recently developed measure, a /spl alpha/-JR divergence, as an alternative to mutual information (MI). We also present in this paper, its potential as an improved ICA criterion, and demonstrate its performance. We also propose a computationally efficient technique to approximate Renyi mutual divergence and apply it to analyze dependent data.