The Italian DPC: infrastructure and operations for the Italian contribution to the Gaia data processing and analysis consortium
R. Messineo, R. Morbidelli, M. Martino, Enrico Pigozzi, A. F. Mulone, Alberto Vecchiato · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2012
This paper describes the design and the implementation of the Italian Data Processing Centre multi-tier software and hardware infrastructure, built by ALTEC and funded by ASI, to support the Italian participation to the Gaia data processing tasks. In particular the paper focuses on the software and hardware architectural choices adopted to manage both big data volumes and complex operations scenarios. The DPCT system has been designed as an integrated system whit the capability to manage all data processing pipeline phases: data receiving, data processing, data extraction, data archiving and data sending. In addition, the DPCT system includes also data access and analysis tools allowing Italian scientists to be active system users during operations.