Controlling the execution steps of data processing algorithm with visual workflow
Alexander G. Tsidaev · AIP conference proceedings · 2019
This paper describes principles of the workflow-based automation for scientific calculations and the 3rd party software execution. Manual way of execution of different programs on different stages of calculations or modelling is routine and not time-efficient. Using the predefined workflow with configurable parameters helps researcher to avoid errors induced by inattention on the manually performed steps. These principles were used to build software for the geophysical calculations. Another described option for workflow integration is the parallel supercomputing on remote hardware. One of modules of the program is intended to wrap SLURM (popular software for time management on supercomputers) interaction over Secure Shell (SSH).