Gradient descent learning in perceptrons: A review of its possibilities
M. -C. Bouten, J. Schietse, C. Van den Broeck · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 1995
We present a streamlined formalism which reduces the calculation of the generalization error for a perceptron, trained on random examples generated by a teacher perceptron, to a matter of simple algebra. The method is valid whenever the student perceptron can be identified as the unique minimum of a specific cost function. The asymptotic generalization error is calculated explicitly for a broad class of cost functions, and a specific cost function is singled out that leads to a generalization error extremely close to the one of the Bayes classifier.