Characterizing the I/O Behavior of HPC Applications through Modeling and Simulation

2026-08-27

AI Summary

本文通过开发一个在ElastiSim模拟环境中再现HPC应用程序I/O访问模式的框架，以优化并行I/O性能和分析I/O行为。

Abstract

Parallel applications process large amounts of data, leading to intensive parallel I/O operations. These operations can exhibit different levels of complexity, including, among others, multiple I/O access patterns, data staging, and contention risks. Therefore, in order to exploit high-performance computing (HPC) systems efficiently and optimize the I/O performance, it is crucial to consider the I/O behaviour of the HPC applications. In this work, we have developed a framework that reproduces the I/O access pattern of real applications in a simulated environment provided by ElastiSim, a batch-system simulator for rigid, malleable, and evolving workloads. The simulated applications are generated based on I/O traces captured from real applications provided by the HPC Input/Output (HPCIO) analysis repository. The HPCIO analysis database includes traces combined with information about real applications' performance across different parallel I/O libraries and layers of the I/O stack. We have conducted detailed case studies of real-world applications' traces to demonstrate how the proposed modeling framework can provide insights into the performance characteristics of I/O applications, including the I/O congestion analysis based on the application's I/O access pattern.

Problem

• HPC
• I/O Performance
• Parallel I/O
• Data Staging
• Contention

Innovation

• ElastiSim
• I/O Access Pattern
• Simulation Framework
• HPCIO Analysis
• Performance Characterization