A Study on the Convergence of Gradient Method with Momentum for Sigma-Pi-Sigma Neural Networks
Xun Zhang, Naimin Zhang · Journal of Applied Mathematics and Physics · 2018
In this paper, a gradient method with momentum for sigma-pi-sigma neural networks (SPSNN) is considered in order to accelerate the convergence of the learning procedure for the network weights. The momentum coefficient is chosen in an adaptive manner, and the corresponding weak convergence and strong convergence results are proved.