A Class of Shannon-Mcmillan Approximation Theorems for Arbitrary Discrete Information Source
Kangkang Wang · Journal of Mathematical Research and Exposition · 2007
In this paper,a class of small-deviation theorems for the relative entropy densities of the arbitrary stochastic sequence are discussed by comparing two joint distributions.As corollaries,some Shannon-Mcmillan theorems for arbitrary information source,m-order Markov information source are obtained and some results for the discrete information source are extended.