The evolution of variable learning rates
John A. Bullinaria · 2002
Neural plasticity in humans is well known to be age dependent, with `critical periods' for the learning of many tasks. It is reasonable to hypothesise that this has some intrinsic advantage over constant plasticity, and that it has arisen as the result of evolution by natural selection. If this is true, then it may also prove useful for building more efficient artificial systems that are required to learn how to perform appropriately. In this paper I explore these ideas with a series of explicit evolutionary simulations of some simplified control systems.