Effect of Slow Switching of Ensemble Teachers in On-line Learning
Seiji Miyoshi, Masato Okada · Journal of the Physical Society of Japan · 2009
We have analyzed the generalization performance of a student which slowly switches ensemble teachers. By calculating the generalization error analytically using statistical mechanics in the framework of on-line learning, we show that the dynamical behaviors of generalization error have a periodicity that is synchronized with the switching period and that the behaviors differ with the number of ensemble teachers. Furthermore, we show that the smaller the switching period is, the larger the difference in behavior is.