Noise-Driven Manifestation of Learning in Mature Neural Networks
Christopher Pineda Monterola, Caesar A. Saloma · Physical Review Letters · 2002
We show that the generalization capability of a mature thresholding neural network to process above-threshold disturbances in a noise-free environment is extended to subthreshold disturbances by ambient noise without retraining. The ability to benefit from noise is intrinsic and does not have to be learned separately. Nonlinear dependence of sensitivity with noise strength is significantly narrower than in individual threshold systems. Noise has a minimal effect on network performance for above-threshold signals. We resolve two seemingly contradictory responses of trained networks to noise-their ability to benefit from its presence and their robustness against noisy strong disturbances.