Data Analysis in Hep: A Statistical Toolkit

Donadio Stefania, Grazia Pia Maria, Guatelli Susanna, Mascialino Barbara, Pfeiffer Andreas, Ribon Alberto, Viarengo Paolo · Istituto Nazionale di Fisica Nucleare. Centro Nazionale Analisi Fotogrammi · 2004

Statistical methods play a significant role through out the life-cycle of HEP experiments, being an essential component of physics analysis. Only a few basic tools for statistical analysis were available in the public domain FORTRAN libraries for HEP. Nowadays the situation is hardly unchanged even among the libraries of the new generation. The present project in progress aims to develop an object-oriented software toolkit for statistical data analysis. More in particular, the Statistical Comparison component of the toolkit provides algorithms for the comparison of data distributions in a variety of use cases typical of HEP experiments, as regression testing (in various phases of the software life-cycle), validation of simulation through comparison to experimental data, comparison of expected versus reconstructed distributions, comparison of data from different sources - such as different sets of experimental data, or experimental with respect to theoretical distributions. The toolkit contains a variety of goodness-of-fittests, from chi-squared to Kolmogorov-Smirnov, tolessknown, but generally much more powerful tests such as Anderson-Darling, Lilliefors, Cramer-vonMises, Kuiper. Thanks to the component based design and the usage of the standard AIDA interfaces, this tool can be used by other data analysis systems orintegrated in experimental software frameworks. We present the architecture of the system, the statistics methods implemented and the results of its first applications to the validation of the Geant4 Simulation Toolkit and to experimental data analysis.

Read the paper · More papers on PaperTik