Statistical Mechanics of Learning: A Variational Approach for Real Data
Dörthe Malzahn, Manfred Opper · Physical Review Letters · 2002
Using a variational technique, we generalize the statistical physics approach of learning from random examples to make it applicable to real data. We demonstrate the validity and relevance of our method by computing approximate estimators for generalization errors that are based on training data alone.