On the Practical Optimal Momentum Parameters
Naimin Zhang · 2019
This short note presents the optimal parameters of the steepest descent method with momentum for minimizing a quadratic function. Since the existing optimal parameters in the literature rely on the eigenvalue approximation of a matrix with high order, which is very expensive, this note gives another kind of practical optimal parameters without the eigenvalue evaluation.