A Bayesian interpretation for the Hopfield network
Edwin R. Hancock, Josef Kittler · 2002
The Hopfield network is a type of associative memory capable of recovering stored patterns when presented with their corrupted realizations. It is the intention of the authors to demonstrate that it has a Bayesian interpretation. The framework for their study is a relaxation method which involves direct probabilistic modeling of the pattern corruption mechanism. The parameter of this model is the memoryless probability of label errors on nodes of the network. It is demonstrated that the Hopfield model is a limit of the relaxation approach with precise physical meaning in terms of this parameter. This label-error probability allows understanding of more general properties of Bayesian pattern reconstruction by relaxation.>