Signal recovery from Pooling Representations
Joan Bruna Estrach, Arthur D. Szlam, Yann LeCun · International Conference on Machine Learning · 2014
In this work we compute lower Lipschitz bounds of lp pooling operators for p = 1, 2, ∞ as well as lp pooling operators preceded by half-rectification layers. These give sufficient conditions for the design of invertible neural network layers. Numerical experiments on MNIST and image patches confirm that pooling layers can be inverted with phase recovery algorithms. Moreover, the regularity of the inverse pooling, controlled by the lower Lipschitz constant, is empirically verified with a nearest neighbor regression.