Entropy of a bit-shift channel
Stan Baggen, Vladimir B. Balakirsky, Dee Denteneer, Sebastian Egner, Henk D. L. Hollmann, Ludo Tolhuizen, Evgeny A. Verbitskiy · Institute of Mathematical Statistics eBooks · 2006
We consider a simple transformation (coding) of an iid source called a bit-shift channel. This simple transformation occurs naturally in magnetic or optical data storage. The resulting process is not Markov of any order. We discuss methods of computing the entropy of the transformed process, and study some of its properties.