The International Planning Competition Series and Empirical Evaluation of AI Planning Systems
Derek Long, Maria Fox · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · 2006
Abstract. In this paper we consider the role of the International Planning Competition series in the evaluation of planners, both directly through the events themselves, and indirectly through the creation of resources and infrastructure. We also consider the problem of evaluation based on data collected both in the competitions and otherwise and examine some of the issues that arise in attempting to formulate and test hypotheses around the data. 1