SC19 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Spack Meets Singularity: Creating Movable In-Situ Analysis Stacks with Ease


Workshop: Spack Meets Singularity: Creating Movable In-Situ Analysis Stacks with Ease

Abstract: In-situ data analysis and visualization is a promising technique to handle the enormous amount of data an extreme-scale application produces. One challenge users often face in adopting in-situ techniques is setting the right environment on a target machine. Platforms such as SENSEI require complex software stacks that consist of various analysis packages and visualization applications. The user has to make sure all these prerequisites exist on the target machine, which often involves compiling and setting them up from scratch. In this paper, we leverage the containers technology (e.g., light-weight virtualization images) and provide users with Singularity containers that encapsulate ready-to-use, movable in-situ software stacks. Moreover, we make use of Spack to ease the process of creating these containers. Finally, we evaluate this solution by running in-situ analysis from within a container on an HPC system.






Back to ISAV 2019: In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization Archive Listing


Back to Full Workshop Archive Listing