INCREMENTAL LEARNING OF CONVOLUTIONAL NEURAL NETWORKS
Dušan Medera, Štefan Babinec · 2009
Convolutional neural networks provide robust feature extraction with ability to learn complex, highdimensional non-linear mappings from collection of examples. To accommodate new, previously unseen data, without the need of retraining the whole network architecture we introduce an algorithm for incremental learning. This algorithm was inspired by AdaBoost algorithm. It utilizes ensemble of modified convolutional neural networks as classifiers by generating multiple hypotheses. Furthermore, with this algorithm we can work with the confidence score of classification, which can play crucial importance in specific real world tasks. This approach was tested on handwritten numbers classification. The classification error achieved by this approach was highly comparable with non-incremental learning.