February 2024

Conference Paper

Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments

By:
Titov, Mikhail; Carson, Robert; Rolchigo, Matthew R; Coleman, John S; Belak, James; Bement, Matthew T; Laney, Daniel; Turilli, Matteo; Jha, Shantenu
Page Number:
2097-2108
Book Title:
Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
Publication Date:
February 2024
Publisher Location:
Association for Computing Machinery, New York, New York, United States of America
Conference Name:
WORKS: 18th Workshop on Workflows in Support of Large-Scale Science
Conference Location:
Denver, Colorado, United States of America
Conference Sponsor:
Supercomputing 2023
View DOI Listing:
https://doi.org/10.1145/3624062.3626283

Abstract

The annual Workshop on Workflows in Support of Large-Scale Science (WORKS) is a premier venue for the scientific workflow community to present the latest advances in research and development on the many facets of scientific workflows throughout their life-cycle. The Lightning Talks at WORKS focus on describing a novel tool, scientific workflow, or concept, which are work-in-progress and address emerging technologies and frameworks to foster discussion in the community. This paper summarizes the lightning talks at the 2023 edition of WORKS, covering five topics: leveraging large language models to build and execute workflows; developing a common workflow scheduler interface; scaling uncertainty workflow applications on exascale computing systems; evaluating a transcriptomics workflow for cloud vs. HPC systems; and best practices in migrating legacy workflows to workflow management systems.

Related Researchers