Sparsity vs. Statistical Independence in Adaptive Signal Representations: A Case Study of the Spike Process
Bertrand Bénichou, Naoki Saito · arXiv (Cornell University) · 2001
Finding a basis/coordinate system that can efficiently represent an input data stream by viewing them as realizations of a stochastic process is of tremendous importance in many fields including data compression and computational neuroscience. Two popular measures of such efficiency of a basis are sparsity (measured by the expected $\ell^p$ norm, $0 2$.