Real time output derivatives for on chip learningusing digital stochastic bit stream neurons
M. van Daalen, J. Zhao, John S. Shawe-Taylor · Electronics Letters · 1994
The authors present the hardware design of an extremely compact and novel digital stochastic neuron, that has the ability to generate the derivative of its output with respect to an arbitrary input. These derivatives may be used to form the basis of an on chip gradient descent learning algorithm.