Two-stage hybrid tuning algorithm for training neural networks in image vision applications
George A. Papakostas, Yiannis S. Boutalis, Sofoklis Samartzidis, D.A. Karras, B.G. Mertzios · International Journal of Signal and Imaging Systems Engineering · 2008
In the present paper a comparative study of two possible combinations of the Backpropagation (BP) and a Genetic Algorithm (GA), for Neural Networks training is performed. The performance of these approaches is compared to each other and to each algorithm incorporated separately in the training procedure. The construction of hybrid optimisation algorithms is originated from the need to manipulate and solve difficult optimisation problems by combining their advantages. The locality and globality behaviour of BP and GA is investigated by the presented hybrid structures, by applying them in five popular benchmark problems. In a second phase, the most efficient of these hybrid algorithms is used, in a typical pattern recognition task. It is concluded, that a more sophisticated structure based on the collaboration of two powerful optimisation algorithms can be used to train a typical neural network more efficiently.