Asymptotic normality of the posterior in relative entropy
Bertrand S. Clarke · IEEE Transactions on Information Theory · 1999
We show that the relative entropy between a posterior density formed from a smooth likelihood and prior and a limiting normal form tends to zero in the independent and identically distributed case. The mode of convergence is in probability and in mean. Applications to code lengths in stochastic complexity and to sample size selection are discussed.