Analytical and numerical study of internal representations in multilayer neural networks with binary weights

Simona Maria Cocco, Rémi Monasson, Riccardo Zecchina · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 1996

We study the weight space structure of the parity machine with binary weights by deriving the distribution of volumes associated to the internal representations of the learning examples. The learning behavior and the symmetry breaking transition are analyzed and the results are found to be in very good agreement with the extended numerical simulations. \textcopyright{} 1996 The American Physical Society.

Read the paper · More papers on PaperTik