Many-body approach to the dynamics of batch learning
K. Y. Michael Wong, S. Li, Y. W. Tong · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 2000
Using the cavity method and diagrammatic methods, we model the dynamics of batch learning of restricted sets of examples, widely applicable to general learning cost functions, and fully taking into account the temporal correlations introduced by the recycling of the examples. The approach is illustrated using the Adaline rule learning teacher-generated or random examples.