The interactions between ergodic theory and information theory
Paul C. Shields · IEEE Transactions on Information Theory · 1998
Information theorists frequently use the ergodic theorem; likewise entropy concepts are often used in information theory. Recently, the two subjects have become partially intertwined as deeper results from each discipline find use in the other. A brief history of this interaction is presented in this paper, together with a more detailed look at three areas of connection, namely, recurrence theory, blowing-up bounds, and direct sample-path methods.