Back from infinity: a constrained resources approach to information theory
J. Ziv · 2002
The classical results of information theory are mostly asymptotic in nature. Tighter results are called for, when there are constraints on the encoding or decoding resources (delay, memory-size, or computational complexity). Some old, as well as some new results addressing these problems are discussed.