Optimization via efficient learning in CNNs: Cognitively-motivated temporal discount functions in SRNNs
Róbert Kozma, Roman Ilin · 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010) · 2010
Cellular Neural Networks (CNNs) are universal computing machines embodying basic computational principles of cortical tissues. Simultaneous Recurrent Neural Networks (SRNNs) have shown clear advantages in solving complex optimization and decision making problems. Based on biological intuition, we introduce temporal discount functions in training SRNNs as a generalization of the adaptive learning rate concept. The proposed procedure results in drastic, 3-5-fold acceleration of learning, demonstrated through the maze navigation problem.