Efficient Per-Example Gradient Computations
Ian Goodfellow · arXiv (Cornell University) · 2015
This technical report describes an efficient technique for computing the norm of the gradient of the loss function for a neural network with respect to its parameters. This gradient norm can be computed efficiently for every example.