QMutBench: A Dataset of Quantum Circuit Mutants

2026-04-17

AI Summary

This work addresses the lack of fault-injected benchmark programs in quantum software testing, which hinders effective evaluation of test cases. To bridge this gap, the authors propose and construct QMutBench, a large-scale benchmark dataset comprising over 700,000 mutated quantum circuits that encompass diverse fault types. QMutBench is the first dataset to enable flexible filtering along multiple dimensions—including original circuit, mutation operator type, and mutant survival rate—and is publicly accessible via an online interface. By providing a customizable and reproducible evaluation infrastructure for mutation-based quantum software testing, QMutBench significantly advances both research and practical applications in this emerging field.

Technology Category

• Machine Learning: Quantum Machine Learning
• Knowledge Representation and Reasoning: Qualitative Reasoning
• Search and Optimization: Sampling/Simulation-based Search

Application Category

• Security and Privacy: Large-scale security measurements
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

Quantum software testing has attracted interest in recent years, prompting the development of various techniques to automate the testing of quantum software. These techniques generate test cases that must be assessed for their effectiveness in detecting faults. Such an assessment requires benchmarks of faulty programs. However, there is a lack of benchmarks containing faults. In this data showcase, we propose QMutBench, a dataset that contains over 700,000 quantum circuit mutants representing different faults. The dataset is accessible via an online interface with selection criteria, such as the original quantum circuit(s) from which mutants are generated, the desired survival rate of the selected mutants, and other mutation characteristics (e.g., the type of faulty quantum gate). QMutBench provides quantum software developers and testers with an accessible online dataset to obtain benchmarks of mutants necessary to assess either the quality of the test cases generated by their testing technique or to compare different testing techniques. It also enables the development of new mutation-guided quantum software testing techniques.

Problem

• quantum software testing
• fault detection
• benchmark
• mutant dataset
• quantum circuit

Innovation

• quantum software testing
• mutation analysis
• benchmark dataset
• quantum circuit mutants
• fault injection