SlideRule Software as a model for Open Source Science for Earth System Observatory Mission Science Data Processing
JP Swinski, Henderson, Scott, Jessica Scheick, Neumann, Thomas, David Shean, Benjamin B. Smith, Tyler Clark Sutterley, Ugarte, Carlos · Zenodo (CERN European Organization for Nuclear Research) · 2022
SlideRule is a software framework for on demand science data processing on Cloud computing infrastructure that involves several innovative open-source software packages working in concert. SlideRule development has been guided by a fundamental change in the way Earth science data is distributed by institutions and interacted with by data users. Historically, institutions pre-generate datasets which are archived and made available via data centers. Data users download parts of those datasets from the data centers and perform local processing and analysis. SlideRule models an alternative approach that is centered around services. Institutions make science data available via web services, and data users integrate those web services directly into their existing data analysis systems. This new approach is enabled by co-locating low-level instrument data with scalable compute resources, and permits efficient generation of both global standard products and custom user-defined derived datasets.