Dissecting self-describing data formats to enable advanced querying of file metadata

Kira Duwe, Michael Kühn · 2021

In times of continuously growing data sizes, performing insightful analysis is increasingly difficult. I/O libraries such as NetCDF and ADIOS2 offer options to manage additional metadata to make the data retrieval more efficient. However, queries on this metadata are difficult as it is currently stored inside the corresponding self-describing data formats.

Read the paper · More papers on PaperTik