Information capacity of the Hopfield model
Yaser S. Abu‐Mostafa, J. St. Jacques · IEEE Transactions on Information Theory · 1985
The information capacity of general forms of memory is formalized. The number of bits of information that can be stored in the Hopfield model of associative memory is estimated. It is found that the asymptotic information capacity of a Hopfield network ofNneurons is of the orderN^{3}b. The number of arbitrary state vectors that can be made stable in a Hopfield network ofNneurons is proved to be bounded above byN.