Building a Software Stack for Quantum-HPC Integration

2025-03-03

AI Summary

Addressing the challenges of heterogeneous resource scheduling, cross-paradigm data movement, and unified access to both NISQ and fault-tolerant quantum devices in deep quantum–HPC integration, this paper proposes the first hardware-agnostic quantum–supercomputing fusion software stack. Methodologically, it introduces (1) a quantum–classical unified resource management framework; (2) a hardware-abstracted programming interface and a cross-platform Quantum Platform Manager API; and (3) a quantum gateway supporting REST/gRPC, a hybrid scheduler, and a quantum-circuit co-optimization toolchain. The stack seamlessly integrates with mainstream HPC job schedulers (e.g., Slurm, PBS). Empirical evaluation on hybrid algorithms—including the variational quantum linear solver—on real supercomputing systems demonstrates significant improvements in quantum–classical resource utilization and task throughput. The design is both practically deployable and inherently scalable, establishing a foundational infrastructure for large-scale quantum–HPC convergence.

Technology Category

• Machine Learning: Quantum Machine Learning
• Planning, Routing, and Scheduling: Learning for Planning and Scheduling
• Search and Optimization: Mixed Discrete/Continuous Search

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

This paper presents a comprehensive software stack architecture for integrating quantum computing (QC) capabilities with High-Performance Computing (HPC) environments. While quantum computers show promise as specialized accelerators for scientific computing, their effective integration with classical HPC systems presents significant technical challenges. We propose a hardware-agnostic software framework that supports both current noisy intermediate-scale quantum devices and future fault-tolerant quantum computers, while maintaining compatibility with existing HPC workflows. The architecture includes a quantum gateway interface, standardized APIs for resource management, and robust scheduling mechanisms to handle both simultaneous and interleaved quantum-classical workloads. Key innovations include: (1) a unified resource management system that efficiently coordinates quantum and classical resources, (2) a flexible quantum programming interface that abstracts hardware-specific details, (3) A Quantum Platform Manager API that simplifies the integration of various quantum hardware systems, and (4) a comprehensive tool chain for quantum circuit optimization and execution. We demonstrate our architecture through implementation of quantum-classical algorithms, including the variational quantum linear solver, showcasing the framework's ability to handle complex hybrid workflows while maximizing resource utilization. This work provides a foundational blueprint for integrating QC capabilities into existing HPC infrastructures, addressing critical challenges in resource management, job scheduling, and efficient data movement between classical and quantum resources.

Problem

• Integrating quantum computing with HPC environments.
• Developing a hardware-agnostic quantum software framework.
• Enhancing resource management and job scheduling in hybrid systems.

Innovation

• Unified resource management for quantum-classical systems
• Flexible quantum programming interface abstracts hardware
• Quantum Platform Manager API simplifies hardware integration