A Continuous Integration-Based Framework for Software Management

Samuel Khuvis, Zhi-Qiang You, Heechang Na, Scott R. Brozell, Eric Franz, Trey Dockendorf, Judith D. Gardiner, Karen A. Tomko · Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) · 2019

Automated software-installation tools such as EasyBuild and Spack have enabled HPC support staff to more quickly deploy software environments for HPC. However, to provide reliable user-facing software environments, any change made to the environments should be recorded and tested. In this paper, we will describe a continuous integration-based framework for software management in use at the Ohio Supercomputer Center (OSC). In this framework, we rely on homegrown tools for automated software build and installation and the ReFrame framework to setup the testing system which can be triggered on commit to a local Gitlab repository. We will document the workflow and explain how we can deploy the software environment quickly and confidently using these tools.

Read the paper · More papers on PaperTik