Generalization in a diluted neural network
C R da Silva, Francisco A. Tamarit, Ney Lemke, Jeferson J. Arenzon, Evaldo M. F. Curado · Journal of Physics A Mathematical and General · 1995
We study the generalization capability of an extreme and asymmetrically diluted version of the Hopfield model through analytical and simulation techniques. Generalization is the ability of the system for grouping a given set of correlated patterns (the examples) in distinct classes (concepts), in such a way that each concept represents the common features of a set of examples and are attractors of the network dynamics. The dynamics of the system can be solved exactly and the generalization error for the long-time regime can be evaluated. As occur for the storage capacity, here it is shown that dilution improves the performance of the network as a categorization device when confronted with the fully connected Hopfield model.