A simple and efficient way to store many messages using neural cliques
Vincent Gripon, Claude Berrou · 2011
Associative memories are devices that are able to learn messages and to recall them in presence of errors or erasures. Their mechanics is similar to that of error correcting decoders. However, the role of correlation is opposed in the two devices, used as the essence of the retrieval process in the first one and avoided in the latter. In this paper, original codes are introduced to allow the effective combination of the two domains. The main idea is to associate a clique in a binary neural network with each message to learn. The obtained performance is dramatically better than that given by the state of the art, for instance Hopfield Neural Networks. Moreover, the model proposed is biologically plausible; it uses sparse binary connections between clusters of neurons provided with only two operations: sum and selection of maximum.