StartR: a tool for large multi-dimensional data processing
Núria Pérez‐Zanón, An-Chi Ho, Nicolau Manubens, Francesco Benincasa, Pierre-Antoine Bretonnière · UPCommons institutional repository (Universitat Politècnica de Catalunya) · 2021
Nowadays, the huge amount of data produced in various scientific domains has made data analysis challenging. In the climate science domain, with the constant increase of resolution in all possible dimensions of model output and the growing need for using computationally demanding analytical methodologies (e.g. bootstrapping), basic operations like extracting data from storage and performing statistical analysis on them must fulfill scientific and operational needs taking into account the growing volume and variety of data. A tool that facilitates data processing and leverages computational resources can largely save researchers’ time and effort. In this work, we introduce startR, an R package that allows to retrieve, arrange, and process large multi-dimensional datasets automatically with a concise workflow, smoothing the data-processing difficulty mentioned above.