Investigation, prototyping and deployment of a higher-level service for data transport
Jay van Schyndel, Silver, Joshua, David Poger · Zenodo (CERN European Organization for Nuclear Research) · 2021
Moving data reliably, securely and at high speed was identified as important in the report “Orchestration and management of data generated by big-data electron microscopy instruments: A Discovery report” (DOI: 10.5281/zenodo.4744876). The present report focuses on the selection of an appropriate tool for data transport, namely Globus, and its prototyping, testing and deployment at two sites. User documentation and guidelines to deploy Globus have been developed and made available online in open access. This work was undertaken under Work Package 4: “Big-data electron and correlative microscopy from instrument to publication” of the Australian Characterisation Commons at Scale (ACCS) project.