Balancing ensemble learning through error shif
Yong Liu · 2011
In neural network learning, it has been often observed that some data have been learned extremely well while others have been barely learned. Such unbalanced learning often lead to the learned neural networks or neural network ensembles that could be too strongly biased on those learned-well data. The stronger bias could contribute to the larger variance and the poorer generalization on the unseen data. It is necessary to prevent a learned model from being strong biased especially when the model have unnecessary large complexity for the application. This paper shows how balanced ensemble learning could guide learning to being less biased through error shift, and create weak learners in an ensemble.