ICARUS Signal Processing With HEPnOS
Sajid Ali · 2023
Current workflow uses a file-based workflow suited for grid-computing: -Input is a set of files, each containing ~30 events, ~10-20 Gb (for ICARUS).-Run each task (set of analysis modules) in the analysis pipeline as a process.-Size of a task is limited by available time, memory, disk space for output files.-Use files to pass the results between tasks.• ICARUS uses the art framework to analyze events.Each art instance can concurrently process multiple events (each harnessing multiple-threads).• Typically, one art process runs on a node and analyzes all the events in a file, producing one output file containing the data products produced by the analysis and ones produced by preceding analysis.• Thus, we typically have fewer art processes than files!Background: File-based workflows for grid-computing 5/