System-Level Support for Composition of Applications
Brian Kocoloski, John R. Lange, Hasan Abbasi, David E. Bernholdt, Terry Jones, Jai Dayal, Noah Paul Evans, Michael Lang, Jay Lofstead, Kevin Pedretti, Patrick G. Bridges · 2015
Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.