SC19 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Poster 84: ESTEE: A Simulation Toolkit for Distributed Workflow Execution

Authors: Vojtěch Cima (IT4Innovations, Czech Republic), Jakub Beránek (IT4Innovations, Czech Republic), Stanislav Böhm (IT4Innovations, Czech Republic)

Abstract: Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm. Many scheduling heuristics have been proposed in existing works; nevertheless, they are often tested in oversimplified environments. We introduce a simulation environment designed for prototyping and benchmarking task schedulers. Our simulation environment, scheduler source codes, and graph datasets are open in order to be fully reproducible. To demonstrate usage of Estee, as an example, we compare the performance of various workflow schedulers in an environment using two different network models.

Best Poster Finalist (BP): no

Poster: PDF
Poster summary: PDF

Back to Poster Archive Listing