Supervised Learning of Probability Distributions by Neural Networks
Eric B. Baum, Frank A. Wilczek · Neural Information Processing Systems · 1987
We propose that the back propagation algorithm for supervised learning can be generalized, put on a satisfactory conceptual footing, and very likely made more efficient by defining the values of the output and input neurons as probabilities and varying the synaptic weights in the gradient direction of the log likelihood, rather than the 'error'.