On the Transmission of Bernoulli Sources Over Stationary Channels
John C. Kieffer · The Annals of Probability · 1980
For a discrete-time finite-alphabet stationary channel $ u$ satisfying a weak continuity requirement, it is shown that there are capacities $C_s( u)$ and $C_b( u)$ which have the following operational significance. A Bernoulli source $\mu$ is transmissible over $ u$ via sliding-block coding if and only if the entropy $H(\mu)$ of $\mu$ is no greater than $C_s( u); \mu$ is transmissible via block coding if and only if $H(\mu)$ is no greater than $C_b( u)$. The weak continuity requirement is satisfied for the $\bar{d}$-continuous channels of Gray-Ornstein as well as other channels. An example of a channel is given to show that the case $C_s( u) eq C_b( u)$ can occur.