Appendix 10: Generalized delta rule
Partha Pratim Kanjilal · Institution of Engineering and Technology eBooks · 1995
The derivation of the generalized delta rule (GDR) which is due to Rumelhart, Hinton and Williams (1986) is presented here. GDR gives an expression for the adaptive change in the weights on the interconnection between the nodes minimizing the cost. GDR is based on the gradient descent algorithm, according to which the adaptation in the weights is proportional to the gradient error.