A Coding Theorem for a Class of Stationary Channels With Feedback
Young-Han Kim · IEEE Transactions on Information Theory · 2008
A coding theorem is proved for a class of stationary channels with feedback in which the output Yn= f(Xn-mn, Zn-mn) is the function of the current and past m symbols from the channel input Xnand the stationary ergodic channel noise Zn. In particular, it is shown that the feedback capacity is equal to limnrarrinfinsupp(xn||yn-1)1/n I(Xnrarr Yn) where I(Xnrarr Yn) = Sigmai=1nI(Xi; Yi|Yi-1) denotes the Massey directed information from the channel input to the output, and the supremum is taken over all causally conditioned distributions p(xn||yn-1) = Pii=1np(xi|xi-1,yi-1). The main ideas of the proof are a classical application of the Shannon strategy for coding with side information and a new elementary coding technique for the given channel model without feedback, which is in a sense dual to Gallager's lossy coding of stationary ergodic sources. A similar approach gives a simple alternative proof of coding theorems for finite state channels by Yang-Kavcic-Tatikonda, Chen-Berger, and Permuter-Weissman-Goldsmith.