Homogeneous Sets of ATP Problems
Matthias Fuchs, Geoff Sutcliffe · 2000
Abstract This report describes how the homogeneity of sets of ATP problems can be measured with respect to the performance of ATP systems. Measuring homogeneity is important as a basis for empirical evaluation of ATP systems and problems. The method developed assigns problems to nodes in a graph, and finding homogeneous sets of problems is reduced to finding maximal cliques in the graph. The method is robust to the realities of empirical data collection. A machine learning approach has been used to differentiate between types of problems in situations where heterogeneity is apparent. 1