Convergence of Online Gradient Method with a Penalty Term for BP Neural Network with Stochastic Inputs
LU Hui-fang, Wei Wu · Journal of Mathematical Research and Exposition · 2007
In this paper,we present and discuss an online gradient method with a penalty term for three- layer BP neural networks.The input training examples are reset stochastically before the performance of each batch so that the learning is easy to jump off from local minima.The monotonicity and the convergence of deterministic nature are proved.