What is the interpretation of spectral entropy?
Jerry D. Gibson · 2002
In 1960 Campbell used a version of the asymptotic equipartition property (AEP) to derive a relationship between the entropy of the source power spectral density and the minimum coefficient rate required to encode the source. Abramson (1985) subsequently provided a brief discussion of Campbell's coefficient rate and a qualitative comparison to the mean squared prediction error of samples taken at the Nyquist rate. Mester and Franke (1992) investigated the spectral entropy as an alternative measure of energy compaction in transform coding. Otherwise there has been very little interest in spectral entropy in the literature. We analyse the spectral entropy and compare it to the familiar entropy rate power for autoregressive processes. We also discuss a possible limitation on its utility for a class of random processes.>