Convergence of Asynchronous Gradient Method with Momentum for Ridge Polynomial Neural Networks
Yu Xi · 2013
The momentum was introduced into the conventional error function of asynchronous gradient method to improve the convergence efficiency of Ridge Polynomial neural network.This paper studied the convergence of the asynchronous gradient method with momentum for training Ridge Polynomial neural network,and a monotonicity theorem and two convergence theorems were proved,which are important for choosing appropriate learning rate and initial weights to perform an effective training.To illustrate above theoretical finding,a simulation experiment was presented.