The Research of Penalty Functions Based on Neural Networks
Yi Ding, Tian Jiang Wang, Xian Fu · Applied Mechanics and Materials · 2011
The penalty functions are introduced in the negative correlation learning for finding a neural network in an ensemble. It is based on the average output of the ensemble. The idea of penalty function based on the average output is to make each individual network has the different output value to that of the ensemble on the same input. Experiments on a classification task show how the negative correlation learning generates a neural network with penalty functions.