Enabling Agile Analysis of I/O Performance Data with PyDarshan
Jakob Luettgau, Shane Snyder, Tyler J. Reddy, Nikolaus Carl Awtrey, Kevin Harms, Jean Luca Bez, R. Wang, Robert P. Latham, Philip Carns · 2023
Modern scientific applications utilize numerous software and hardware layers to efficiently access data. This approach poses a challenge for I/O optimization because of the need to instrument and correlate information across those layers. The Darshan characterization tool seeks to address this challenge by providing efficient, transparent, and compact runtime instrumentation of many common I/O interfaces. It also includes command-line tools to generate actionable insights and summary reports. However, the extreme diversity of today’s scientific applications means that not all applications are well served by one-size-fits-all analysis tools.