A Variational Approach to Learning Curves
Dörthe Malzahn, Manfred Opper · The MIT Press eBooks · 2002
We combine the replica approach from statistical physics with a variational approach to analyze learning curves analytically. We apply the method to Gaussian process regression. As a main result we derive approximative relations between empirical error measures, the generalization error and the posterior variance. 1