A Bayesian framework for evolutionary computation
Byoung‐Tak Zhang · 2003
A Bayesian framework for evolutionary computation is presented. Given a data set for fitness evaluation the best (fittest) individual is defined as the most probable model of the data with respect to the prior knowledge on the problem domain. In each generation, Bayes theorem is used to estimate the posterior fitness of individuals from their prior fitness values. Offspring individuals are then generated by sampling from the posterior distribution combined with the transition probabilities formed by variation operators. The evolutionary inference steps from the prior via posterior distribution of parent fitness to the expected fitness distribution of offspring are essential elements in Bayesian evolutionary computation. One of the most interesting aspects of Bayesian evolution is that it provides principled techniques for controlling evolutionary dynamics. Specifically, we describe two examples of the application of the Bayesian framework. One is a Bayesian evolutionary algorithm (BEA) designed to evolve parsimonious individuals in evolutionary computation with variable-size representation. We show that the adaptive Occam method for program growth control is a special form of Bayesian evolution. The other example is an evolutionary algorithm with incremental data inheritance (IDI). In this BEA, the fitness of individuals is estimated on incrementally chosen data subsets, rather than on the whole data set, and thus the convergence is accelerated by reducing the effective number of fitness evaluations. Experimental results are provided to show the effectiveness of the BEAs.