NNGD algorithm for neural adaptive filters
Danilo P. Mandic · Electronics Letters · 2000
A novel normalised nonlinear gradient descent (NNGD) algorithm for training neural adaptive feedforward filters is presented. The algorithm is based on minimisation of the instantaneous prediction error for contractive activation functions of a neuron, and provides an adaptive learning rate. Normalisation is performed via calculation of the product of the tap input power to the filter and the squared first derivative of the activation function of a neuron. The NNGD algorithm outperforms a gradient based algorithm for use in a neural adaptive filter, as well as the standard least mean squares (LMS) and normalised LMS algorithms. To support the analysis, simulation results on real speech are provided.