Vapnik-Chervonenkis entropy of the spherical perceptron
Peter Riegler, H. Sebastian Seung · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 1997
Perceptron learning of randomly labeled patterns is analyzed using a Gibbs distribution on the set of realizable labelings of the patterns. The entropy of this distribution is an extension of the Vapnik-Chervonenkis (VC) entropy, reducing to it exactly in the limit of infinite temperature. The close relationship between the VC and Gardner entropies can be seen within the replica formalism.