Learning arbiter and combiner trees from partitioned data for scaling machine learning
Philip K. Chan, Salvatore J. Stolfo · 1995
Knowledge discovery in databases has become an increas-ingly important research topic with the advent of wide area network computing. One of the crucial problems we study in this paper is how to scale machine learning algorithms, that typically are designed to deal with main memory based datasets, to efficiently learn from large distributed databases. We have explored an approach called meta-learning that is related to the traditional approaches of data reduction com-monly employed in distributed query processing systems. Here we seek efficient means to learn how to combine a number of base classifiers, which are learned from subsets of the data, so that we scale efficiently to larger learning problems, and boost the accuracy of the constituent classi-fiers if possible. In this paper we compare the arbiter tree strategy to a new but related approach called the combiner tree strategy.