Multifractal analysis of the coupling space of feedforward neural networks
Andreas Engel, Martin Weigt · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 1996
Random input patterns induce a partition of the coupling space of feedforward neural networks into different cells according to the generated output sequence. For the perceptron this partition forms a random multifractal for which the spectrum $f(\ensuremath{\alpha})$ can be calculated analytically using the replica trick. A phase transition in the multifractal spectrum corresponds to the crossover from percolating to nonpercolating cell sizes. Instabilities of negative moments are related to the Vapnik-Chervonenkis (VC) dimension [Theor. Prob. Appl. 16, 264 (1971)].