Learning of decision regions based on the genetic algorithm
Leehter Yao · 2002
A method for nonparametric (distribution-free) learning of complex decision regions in n-dimensional pattern space is introduced. Arbitrary n-dimensional decision regions are approximated by the union of a finite number of basic shapes. The primary examples introduced in this paper are parallelepipeds. By explicitly parameterizing these shapes, the decision region can be determined by estimating the parameters associated with each shape. A structural random search type algorithm called the genetic algorithm is modified to estimate these parameters. Modifications include the parent selection scheme and a new operator called "extinction and immigration". Two complex decision regions are examined in detail: one is a linearly inseparable, nonconvex and disconnected type; and the other is linearly inseparable, nonconvex and connected type. The scheme is highly resilient to misclassification errors. The number of the parameters to be estimated only grows linearly with the dimension of the pattern space for simple version of the scheme.>