Integration of OSN-NSDF data movements
Alexander S. Szalay · Zenodo (CERN European Organization for Nuclear Research) · 2022
The “First Meter” Problem: High-throughput instruments have an impedance problem Both for data rate (few TB/min) and data volume (PB) Data needs to be first captured at a high rate and then transferred to an HPC center for processing (where it is free) This can be solved with multiple dedicated local pods acting as high-capacity caches with a customizable NSDF software layer on the back end (compression, data transform).