Distributed Data and Job Management for the XENON1T Experiment
Benedikt Riedel, B. Bauermeister, Lincoln Bryant, Janet M. Conrad, Patrick de Perio, Robert W. Gardner, Luca Grandi, F. Lombardi, Alfio Rizzo, Gabriella Sartorelli, Marco Selvi, E. Shockley, J. Stephen, Suchandra Thapa, Christopher D. Tunnell · 2018
We present the distributed data and job management scheme on the Open Science Grid (OSG) and European Grid Infrastructure (EGI) that was developed for the XENON1T experiment. The experiment aims to detect dark matter using the first ton-scale detector of this kind, a ~2000-kg-target-mass dual-phase (liquid-gas) xenon time projection chamber in operation at the Laboratori Nazionali del Gran Sasso in Italy. The experiment's data is automatically spread across several sites on EGI and OSG. The data location and movement is managed using the rucio software package developed by the ATLAS collaboration. The job submission to OSG, EGI, SDSC's Comet Supercomputer, and campus HPC resources is done through the CI Connect infrastructure that is directly connected to the general OSG infrastructure. This paper will describe the overall integration of distributed storage and compute resources into a common interface, respectively, and integration into the existing XENON1T software