On the capacity of three-layer networks
Shotaro Akaho, Шун-ичи Амари · 1990
A new lower bound on the capacity of three-layer neural networks is given by a constructive method which uses the sparse encoding scheme. The capacity is closely related to the learning ability from examples, giving an estimate of the number of examples to be required for learning a function. It is shown that the capacitymof a neural network withhhidden elements andninput lines satisfies (in the sense of order)nh/log (nh2)mnhlogh