The statistical mechanics of the Ising perceptron
José F. Fontanari, Ron Meir · Journal of Physics A Mathematical and General · 1993
The authors investigate the problem of loading a single-layered perceptron of Ising (+or-1) weights, focusing on the cases of linear and binary output neurons. Previous studies of this problem have been made using the canonical ensemble, which in many cases require the breaking of replica symmetry. They consider here an alternative approach, based on the microcanonical ensemble, and show that many results that were obtained previously using replica symmetry breaking within the canonical ensemble can be easily obtained using the replica-symmetric assumption within the microcanonical ensemble. Since the nature of the replica symmetry breaking in many of the models with discrete weights is similar, they believe that the results can immediately be extended to other cases such as learning a rule from examples, and utilizing discrete weights of larger synaptic depth.