Inequalities involving the incomplete Renyi entropy, divergence and variational distance
Marcelo Sampaio de Alencar, Francisco de Assis · 2002
Relations between the entropies, variational distance and Kullback Leibler distances of two distributions P={p/sub 1/,...,p/sub N/} and Q={q/sub 1/,...,q/sub N/} on the same alphabet A={a/sub 1/,...,a/sub N/}, are found. The concept of Renyi (1961) entropy is used to prove an inequality involving incomplete distributions, subject to a constraint.