Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations
The quantum volume test is a full-system benchmark for quantum computers that is sensitive to qubit number, fidelity, connectivity, and other quantities believed to be important in building useful devices. The test was designed to produce a single-number measure of a quantum computer's general...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Verein zur Förderung des Open Access Publizierens in den Quantenwissenschaften
2022-05-01
|
| Series: | Quantum |
| Online Access: | https://quantum-journal.org/papers/q-2022-05-09-707/pdf/ |
| _version_ | 1818200508592029696 |
|---|---|
| author | Charles H. Baldwin Karl Mayer Natalie C. Brown Ciarán Ryan-Anderson David Hayes |
| author_facet | Charles H. Baldwin Karl Mayer Natalie C. Brown Ciarán Ryan-Anderson David Hayes |
| author_sort | Charles H. Baldwin |
| collection | DOAJ |
| description | The quantum volume test is a full-system benchmark for quantum computers that is sensitive to qubit number, fidelity, connectivity, and other quantities believed to be important in building useful devices. The test was designed to produce a single-number measure of a quantum computer's general capability, but a complete understanding of its limitations and operational meaning is still missing. We explore the quantum volume test to better understand its design aspects, sensitivity to errors, passing criteria, and what passing implies about a quantum computer. We elucidate some transient behaviors the test exhibits for small qubit number including the ideal measurement output distributions and the efficacy of common compiler optimizations. We then present an efficient algorithm for estimating the expected heavy output probability under different error models and compiler optimization options, which predicts performance goals for future systems. Additionally, we explore the original confidence interval construction and show that it underachieves the desired coverage level for single shot experiments and overachieves for more typical number of shots. We propose a new confidence interval construction that reaches the specified coverage for typical number of shots and is more efficient in the number of circuits needed to pass the test. We demonstrate these savings with a $QV=2^{10}$ experimental dataset collected from Quantinuum System Model H1-1. Finally, we discuss what the quantum volume test implies about a quantum computer's practical or operational abilities especially in terms of quantum error correction. |
| first_indexed | 2024-12-12T02:38:47Z |
| format | Article |
| id | doaj.art-63a36d79a4b44b0abcf1f8c419725ff2 |
| institution | Directory Open Access Journal |
| issn | 2521-327X |
| language | English |
| last_indexed | 2024-12-12T02:38:47Z |
| publishDate | 2022-05-01 |
| publisher | Verein zur Förderung des Open Access Publizierens in den Quantenwissenschaften |
| record_format | Article |
| series | Quantum |
| spelling | doaj.art-63a36d79a4b44b0abcf1f8c419725ff22022-12-22T00:41:13ZengVerein zur Förderung des Open Access Publizierens in den QuantenwissenschaftenQuantum2521-327X2022-05-01670710.22331/q-2022-05-09-70710.22331/q-2022-05-09-707Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimationsCharles H. BaldwinKarl MayerNatalie C. BrownCiarán Ryan-AndersonDavid HayesThe quantum volume test is a full-system benchmark for quantum computers that is sensitive to qubit number, fidelity, connectivity, and other quantities believed to be important in building useful devices. The test was designed to produce a single-number measure of a quantum computer's general capability, but a complete understanding of its limitations and operational meaning is still missing. We explore the quantum volume test to better understand its design aspects, sensitivity to errors, passing criteria, and what passing implies about a quantum computer. We elucidate some transient behaviors the test exhibits for small qubit number including the ideal measurement output distributions and the efficacy of common compiler optimizations. We then present an efficient algorithm for estimating the expected heavy output probability under different error models and compiler optimization options, which predicts performance goals for future systems. Additionally, we explore the original confidence interval construction and show that it underachieves the desired coverage level for single shot experiments and overachieves for more typical number of shots. We propose a new confidence interval construction that reaches the specified coverage for typical number of shots and is more efficient in the number of circuits needed to pass the test. We demonstrate these savings with a $QV=2^{10}$ experimental dataset collected from Quantinuum System Model H1-1. Finally, we discuss what the quantum volume test implies about a quantum computer's practical or operational abilities especially in terms of quantum error correction.https://quantum-journal.org/papers/q-2022-05-09-707/pdf/ |
| spellingShingle | Charles H. Baldwin Karl Mayer Natalie C. Brown Ciarán Ryan-Anderson David Hayes Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations Quantum |
| title | Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations |
| title_full | Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations |
| title_fullStr | Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations |
| title_full_unstemmed | Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations |
| title_short | Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations |
| title_sort | re examining the quantum volume test ideal distributions compiler optimizations confidence intervals and scalable resource estimations |
| url | https://quantum-journal.org/papers/q-2022-05-09-707/pdf/ |
| work_keys_str_mv | AT charleshbaldwin reexaminingthequantumvolumetestidealdistributionscompileroptimizationsconfidenceintervalsandscalableresourceestimations AT karlmayer reexaminingthequantumvolumetestidealdistributionscompileroptimizationsconfidenceintervalsandscalableresourceestimations AT nataliecbrown reexaminingthequantumvolumetestidealdistributionscompileroptimizationsconfidenceintervalsandscalableresourceestimations AT ciaranryananderson reexaminingthequantumvolumetestidealdistributionscompileroptimizationsconfidenceintervalsandscalableresourceestimations AT davidhayes reexaminingthequantumvolumetestidealdistributionscompileroptimizationsconfidenceintervalsandscalableresourceestimations |