Problem
Research questions and friction points this paper is trying to address.
Quantum Engineering
Autonomy
Reliability
Evaluating Verified Autonomy in Quantum Engineering
🤖 AI Summary
为解决量子工程中可靠操作问题，研究开发了Quantum-Harbor虚拟实验室和QIQCBench基准，用于评估AI代理在量子系统中的自主性能。
📝 Abstract
Reliable quantum engineering is essential for turning quantum phenomena into practical technologies. As quantum platforms grow in scale and complexity, their characterization and operation require increasing human effort and coordination. Scientific artificial intelligence agents, which can plan experiments, operate instruments, and analyze observations, offer a promising route towards autonomous quantum engineering. Yet whether current agents can perform reliably in this setting has not been systematically established. To fill this gap, we developed Quantum-Harbor, a virtual laboratory that provides a controlled execution environment for agents to interact with quantum systems. This design enables direct verification of both the actions taken and the conclusions drawn. Building on this framework, we introduce QIQCBench, a benchmark of $49$ expert-authored tasks spanning multiple layers including calibration and control, error correction and compilation, sensing and networking. Across $17$ frontier agentic systems, QIQCBench reveals wide variation in verified performance. These results expose a substantial gap between demonstrating capability and achieving reliable operation, and establish Quantum-Harbor as a foundation for measuring progress towards verified autonomy in quantum engineering.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Quantum-Harbor
autonomous quantum engineering
QIQCBench
🔎 Similar Papers
No similar papers found.
