October 2023

Conference Paper

Analyzing File Access Patterns on Large-Scale HPC Systems: Opportunities for File Prefetching

By:
Karimi, Ahmad Maroof ; Paul, Arnab; Choi, Jong Youl ; Wan, Lipeng; Wang, Feiyi
Page Number:
1
Book Title:
2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)
Publication Date:
October 2023
Publisher Location:
IEEE, New Jersey, United States of America
Conference Name:
International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)
Conference Location:
Stony Brook, New York, United States of America
Conference Sponsor:
Various
View DOI Listing:
https://doi.org/10.1109/MASCOTS59514.2023.10387610

Abstract

This paper explores the potential opportunities for implementing file prefetching techniques on large-scale high-performance computing (HPC) systems. Specifically, we investigate the file access patterns of various applications across multiple scientific domains using two years' worth of Darshan I/O traces obtained from the Summit supercomputer. We identify recurring trends and patterns which indicate that prefetching can be effectively leveraged to improve data access performance on HPC systems. This study serves as a valuable reference for system architects and developers in the HPC community, providing insights into the opportunities and challenges associated with enabling file prefetching on large-scale HPC systems.

Related Researchers