Strong Wolfe condition-based variable stacking length multi-gradient parameter identification algorithm
Yiqiao Shi, Shaoxue Jing · International Journal of Modelling Identification and Control · 2022
This paper considers the acceleration of the gradient algorithm for the linear models. Traditional stochastic gradient algorithm requires less computation, but it converges to the true parameter slowly. To accelerate gradient algorithm, a novel gradient algorithm using several gradients is proposed. One important issue of the proposed algorithm is how to determine the stacking length. The stacking length defines the number of gradients used in each recursion. A variable stacking length based on the strong Wolfe condition is presented to enable the algorithm to converge faster. The stacking length obtained by using the SW condition can ensure that the proposed multi-gradient algorithm converges faster. Several experiments are made to validate the proposed algorithm.