The ergodic and entropy theorems revisited
Paul C. Shields · IEEE Transactions on Information Theory · 1987
A new proof of Birkhoff's ergodic theorem is given using a sample path covering idea, an idea created by Ornstein and Weiss in their extension of the information convergence theorem to random fields. A sketch of the Ornstein-Weiss proof for processes is included in the Appendix.