Representing and learning Boolean functions of multivalued features
Steven E. Hampson, Dennis James Volper · IEEE Transactions on Systems Man and Cybernetics · 1990
An analysis and empirical measurement of threshold linear functions of multivalued features is presented. The number of thresholded linear functions, maximum weight size, training speed, and the number of nodes necessary to represent arbitrary Boolean functions are all shown to increase polynomially with the number of distinct values the input features can assume and exponentially with the number of features. Two network training algorithms, focusing and back propagation, are described. Empirically, they are capable of learning arbitrary Boolean functions of multivalued features in a two-level net. Focusing is proved to converge to a correct classification and permits some time-space complexity analysis. Training time for this algorithm is polynomial in the number of values of a feature can assume, and exponential in the number of features. Back propagation is not necessarily convergent, but for randomly generated Boolean functions, the empirical behavior of the implementation is similar to that of the focusing algorithm.>