An overview of a large-scale data migration

Markus Lubeck, D. Geppert, K. Nienartowicz · 2003

We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN's IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an object database management system to a hybrid persistency mechanism based on flat files referenced in a relational database management system.

Read the paper · More papers on PaperTik