Data management tools and operational procedures in ATLAS : Example of the German cloud

Cédric Serfon · Journal of Physics Conference Series · 2010

A set of tools have been developed to ensure the Data Management operations (deletion, consistency checks) within the German cloud for ATLAS. These tools are described hereafter and presented in the context of the operational procedures of the German cloud. A particular emphasis is put on the consistency checks between the different catalogs (LFC, DQ2 Central Catalogs) and the files stored on the Storage Element. These consistency checks are crucial to be sure that all the data stored in the sites are actually available for the users and to get rid of non registered files also known as Dark Data.

Read the paper · More papers on PaperTik