夜色直播

Debunking algorithmic qubits

March 1, 2024
Executive Summary: 夜色直播鈥檚 H-Series computers have the highest performance in the industry, verified by multiple widely adopted benchmarks including quantum volume 聽We demonstrate that an alternative benchmark called algorithmic qubits is deeply flawed, hiding computer performance behind a plurality voting trick and gate compilations that are not widely useful.

Recently a new benchmark called algorithmic qubits (AQ) has started to be confused with quantum volume measurements. Quantum volume (QV) was specifically designed to be hard to 鈥済ame,鈥 however the algorithmic qubits test turns out to be very susceptible to tricks that can make a quantum computer look much better than it actually is. While it is not clear what can be done to fix the algorithmic qubits test, it is already clear that it is much easier to pass than QV and is a poor substitute for measuring performance. It is also important to note that algorithmic qubits are not the same as logical qubits, which are necessary for full fault-tolerant quantum computing.

Fig. 1: Simulations of the algorithmic qubits (AQ) test with only two-qubit gate errors for two hypothetical machines. 聽The machines are identical except one has much higher two qubit gate fidelity. The test was run with three different options: (Base) Running the exact circuits as specified by the algorithmic qubits , (Gate compilation) Running circuits with custom Pytket compiler passes to reduce two-qubit gate counts, and (Gate compilation + plurality voting) Running the compiled circuits and also applying plurality voting error mitigation with voting over 25 random variants each with 100 shots. Note that the quantum volume (QV) of the machines most closely tracks to the 鈥渂ase鈥 case without compilation and plurality voting, but even that base case of AQ can overestimate the QV of the machine. 聽

To make this point clear, we simulated what algorithmic qubits data would look like for two machines, one clearly much higher performing than the other. We applied two tricks that are typically used when sharing algorithmic qubits results: gate compilation and . From the data above, you can see how these tricks are misleading without further information. For example, if you compare data from the higher fidelity machine without any compilation or plurality voting (bottom left) to data from the inferior machine with both tricks (top right) you may incorrectly believe the inferior machine is performing better. Unfortunately, this inaccurate and misleading comparison has been made in the past. 聽It is important to note that algorithmic qubits uses a subset of algorithms from a that introduced a suite of application oriented tests and created a repository to test available quantum computers. 聽Importantly, that work explicitly forbids the compilation and error mitigation techniques that are causing the issue here.

As a demonstration of the perils of AQ as a benchmark, we look at data obtained on both 夜色直播鈥檚 H2-1 system as well as publicly available data from IonQ鈥檚 Forte system.

Fig. 2: Algorithmic qubit data with gate compilation but without plurality voting error mitigation. 聽Data from smaller qubit and gate counts was omitted from the 夜色直播 data as those points do not tend to influence the AQ score. 聽H2-1 has a measured quantum volume of 216. 聽Based on this publicly available data from Forte, combined with the AQ simulation data above, we estimate the Forte quantum volume is around 25, although spread in qubit fidelities and details of circuit compilation could skew this estimate.

We reproduce data without any error mitigation from IonQ鈥檚 in association with a preprint posted to the , and compare it to data taken on our H2-1 device. Without error mitigation, IonQ Forte achieves an AQ score of 9, whereas 夜色直播 H2-1 achieves AQ of 26. Here you can clearly see improved circuit fidelities on the H2-1 device, as one would expect from the higher reported 2Q gate fidelities (average 99.816(5)% for 夜色直播鈥檚 H2-1 vs 99.35% for IonQ鈥檚 Forte). However, after you apply error mitigation, in this case plurality voting, to both sets of data the picture changes substantially, hiding each underlying computer鈥檚 true capabilities.

Fig. 3: Algorithmic qubit data with gate compilation and plurality voting error mitigation. For the H2-1 data plurality voting is done over 25 variants each with 20 shots for every test and qubit number. For Forte it is not clear to us exactly what plurality voting strategy was employed.

Here the H2-1 algorithmic performance still exceeds Forte (from the publicly released data), but the perceived gap has been reduced by error mitigation. 聽

鈥淓rror mitigation, including plurality voting, may be a useful tool for some near-term quantum computing but it doesn鈥檛 work for every problem and it鈥檚 unlikely to be scalable to larger systems. In order to achieve the lofty goals of quantum computing we鈥檒l need serious device performance upgrades. If we allow error mitigation in benchmarking it will conflate the error mitigation with the underlying device performance. This will make it hard for users to appreciate actual device improvements that translate to all applications and larger problems,鈥 explained Dr. Charlie Baldwin, a leader in 夜色直播鈥檚 benchmarking efforts.

There are other issues with the algorithmic qubits test. The circuits used in the test can be reduced to very easy-to-run circuits with basic quantum circuit compilation that are freely available in packages like . For example, the largest phase estimation and amplitude estimation tests required to pass AQ=32 are specified with 992 and 868 entangling gates respectively but applying pytket optimization reduces the circuits to 141 and 72 entangling gates. This is only possible due to choices in constructing the benchmarks and will not be universally available when using the algorithms in applications. Since AQ reports the precompiled gate counts this also may lead users to expect a machine to be able to run many more entangling gates than what is actually possible on the benchmarked hardware.

What makes a good quantum benchmark? Quantum benchmarking is extremely useful in charting the hardware progress and providing roadmaps for future development. However, quantum benchmarking is an evolving field that is still an open area of research. At 夜色直播 we believe in testing the limits of our machine with a variety of different benchmarks to learn as much as possible about the errors present in our system and how they affect different circuits. We are open to working with the larger community on refining benchmarks and creating new ones as the field evolves.

To learn more about the Algorithmic Qubits benchmark and the issues with it, please watch this video where Dr. Charlie Baldwin walks us through the details, starting at 32:40.

About 夜色直播

夜色直播,聽the world鈥檚 largest integrated quantum company, pioneers powerful quantum computers and advanced software solutions. 夜色直播鈥檚 technology drives breakthroughs in materials discovery, cybersecurity, and next-gen quantum AI. With over 500 employees, including 370+ scientists and engineers, 夜色直播 leads the quantum computing revolution across continents.聽

Blog
August 28, 2025
Quantum Computing Joins the Next Frontier in Genomics
  • The Sanger Institute illustrates the value of quantum computing to genomics research
  • 夜色直播 supports developments in a field that promises to deliver a profound and positive societal impact

Twenty-five years ago, scientists accomplished a task likened to a biological : the sequencing of the entire human genome.

The Human Genome Project revealed a complete human blueprint comprising around 3 billion base pairs, the chemical building blocks of DNA. It led to breakthrough medical treatments, scientific discoveries, and a new understanding of the biological functions of our body.

Thanks to technological advances in the quarter-century since, what took 13 years and cost $2.7 billion then in under 12 minutes for a few hundred dollars. Improved instruments such as next-generation sequencers and a better understanding of the human genome 鈥 including the availability of a 鈥渞eference genome鈥 鈥 have aided progress, alongside enormous advances in algorithms and computing power.

But even today, some genomic challenges remain so complex that they stretch beyond the capabilities of the most powerful classical computers operating in isolation. This has sparked a bold search for new computational paradigms, and in particular, quantum computing.

Quantum Challenge: Accepted

The is pioneering this new frontier. The program funds research to develop quantum algorithms that can overcome current computational bottlenecks. It aims to test the classical boundaries of computational genetics in the next 3-5 years.

One consortium 鈥 led by the University of Oxford and supported by prestigious partners including the Wellcome Sanger Institute, the Universities of Cambridge, Melbourne, and Kyiv Academic University 鈥 is taking a leading role.

鈥淭he overall goal of the team鈥檚 project is to perform a range of genomic processing tasks for the most complex and variable genomes and sequences 鈥 a task that can go beyond the capabilities of current classical computers鈥 鈥 Wellcome Sanger Institute , July 2025
Selecting 夜色直播

Earlier this year, the Sanger Institute selected 夜色直播 as a technology partner in their bid to succeed in the Q4Bio challenge.

Our flagship quantum computer, System H2, has for many years led the field of commercially available systems for qubit fidelity and consistently holds the global record for Quantum Volume, currently benchmarked at 8,388,608 (223).

In this collaboration, the scientific research team can take advantage of 夜色直播鈥檚 full stack approach to technology development, including hardware, software, and deep expertise in quantum algorithm development.

鈥淲e were honored to be selected by the Sanger Institute to partner in tackling some of the most complex challenges in genomics. By bringing the world鈥檚 highest performing quantum computers to this collaboration, we will help the team push the limits of genomics research with quantum algorithms and open new possibilities for health and medical science.鈥 鈥 Rajeeb Hazra, President and CEO of 夜色直播
Quantum for Biology

At the heart of this endeavor, the consortium has announced a bold central mission for the coming year: to encode and process an entire genome using a quantum computer. This achievement would be a potential world-first and provide evidence for quantum computing鈥檚 readiness for tackling real-world use cases.

Their chosen genome, the bacteriophage PhiX174, carries symbolic weight, as its sequencing his second Nobel Prize for Chemistry in 1980. Successfully encoding this genome quantum mechanically would represent a significant milestone for both genomics and quantum computing.

Bacteriophage PhiX174, published under a Creative Commons License https://commons.wikimedia.org/wiki/File:Phi_X_174.png

Sooner than many expect, quantum computing may play an essential role in tackling genomic challenges at the very frontier of human health. The Sanger Institute and 夜色直播鈥檚 partnership reminds us that we may soon reach an important step forward in human health research 鈥 one that could change medicine and computational biology as dramatically as the original Human Genome Project did a quarter-century ago.

鈥淨uantum computational biology has long inspired us at 夜色直播, as it has the potential to transform global health and empower people everywhere to lead longer, healthier, and more dignified lives.鈥 鈥 Ilyas Khan, Founder and Chief Product Officer of 夜色直播

Glossary of terms: Understanding how quantum computing supports complex genomic research


Term Definition
Algorithms
A set of rules or processes for performing calculations or solving computational problems.
Classical Computing Computing technology based on binary information storage (bits represented as 0 or 1).
DNA Sequence The exact order of nucleotides (A, T, C, G) within a DNA molecule.
Genome The complete set of genetic material (DNA) present in an organism.
Graph-based Genome (Sequence Graph) A non-linear network representation of genomic sequences capturing the diversity and relationships among multiple genomes.
High Performance Compute (HPC) Advanced classical computing systems designed for handling computationally intensive tasks, simulations, and data processing.
Pangenome A collection of multiple genome sequences representing genetic diversity within a population or species.
Precision Medicine Tailored medical treatments based on individual genetic, environmental, and lifestyle factors.
夜色直播 The world鈥檚 largest quantum computing company, 夜色直播 systems lead the world for the rigorous Quantum Volume benchmark and were the first to offer commercial access to highly reliable 鈥淟evel 2 鈥 resilient鈥 quantum computing.
Quantum Bit (Qubit) Basic unit of quantum information, which unlike classical bits, can exist in multiple states simultaneously (superposition).
Quantum Computing Computing approach using quantum-mechanical phenomena (e.g., superposition, entanglement, interference) for enhanced problem-solving capabilities.
Quantum Pangenomics Interdisciplinary field combining quantum computing with genomics to address computational challenges in analyzing genetic data and pangenomes.
Quantum Volume A specific test of a quantum computer鈥檚 performance on complex circuits. The higher the quantum volume the more powerful the system. 夜色直播鈥檚 56-qubit System Model H2 achieved a record quantum volume of 8,388,608 in May 2025.
Quantum Superposition A fundamental quantum phenomenon in which particles can simultaneously exist in multiple states, enabling complex computational tasks.
Sequence Mapping Determining how sequences align or correspond within a larger genomic reference or graph.
Wellcome Leap Quantum for Bio (Q4Bio) Initiative funding research combining quantum computing and biological sciences to address computational challenges.
Wellcome Sanger Institute The Sanger Institute tackles some of the most difficult challenges in genomic research.
partnership
All
Blog
August 26, 2025
IEEE Quantum Week 2025

Every year, The IEEE International Conference on Quantum Computing and Engineering 鈥 or 鈥 brings together engineers, scientists, researchers, students, and others to learn about advancements in quantum computing.

This year鈥檚 conference from August 31st 鈥 September 5th, is being held in Albuquerque, New Mexico, a burgeoning epicenter for quantum technology innovation and the home to our new location that will support ongoing collaborative efforts to advance the photonics technologies critical to furthering our product development.

Throughout IEEE Quantum Week, our quantum experts will be on-site to share insights on upgrades to our hardware, enhancements to our software stack, our path to error correction, and more.

Meet our team at Booth #507 and join the below sessions to discover how 夜色直播 is forging the path to fault-tolerant quantum computing with our integrated full-stack.

September 2nd


Quantum Software 2.1: Open Problems, New Ideas, and Paths to Scale
1:15 鈥 2:10pm MDT | Mesilla

We recently shared the details of our new software stack for our next-generation systems, including Helios (launching in 2025). 夜色直播鈥檚 Agust铆n Borgna will deliver a lighting talk to introduce Guppy, our new, open-source programming language based on Python, one of the most popular general-use programming languages for classical computing.

September 3rd

PAN08: Progress and Platforms in the Era of Reliable Quantum Computing
1:00 鈥 2:30pm MDT | Apache

We are entering the era of reliable quantum computing. Across the industry, quantum hardware and software innovators are enabling this transformation by creating reliable logical qubits and building integrated technology stacks that span the application layer, middleware and hardware. Attendees will hear about current and near-term developments from Microsoft, 夜色直播 and Atom Computing. They will also gain insights into challenges and potential solutions from across the ecosystem, learn about Microsoft鈥檚 qubit-virtualization system, and get a peek into future developments from 夜色直播 and Microsoft.

BOF03: Exploring Distributed Quantum Simulators on Exa-scale HPC Systems
3:00 鈥 4:30pm MDT | Apache

The core agenda of the session is dedicated to addressing key technical and collaborative challenges in this rapidly evolving field. Discussions will concentrate on innovative algorithm design tailored for HPC environments, the development of sophisticated hybrid frameworks that seamlessly combine classical and quantum computational resources, and the crucial task of establishing robust performance benchmarks on large-scale CPU/GPU HPC infrastructures.

September 4th

PAN11: Real-time Quantum Error Correction: Achievements and Challenges
1:00 鈥 2:30pm MDT | La Cienega

This panel will explore the current state of real-time quantum error correction, identifying key challenges and opportunities as we move toward large-scale, fault-tolerant systems. Real-time decoding is a multi-layered challenge involving algorithms, software, compilation, and computational hardware that must work in tandem to meet the speed, accuracy, and scalability demands of FTQC. We will examine how these challenges manifest for multi-logical qubit operations, and discuss steps needed to extend the decoding infrastructure from intermediate-scale systems to full-scale quantum processors.

September 5th

Keynote by NVIDIA
8:00 鈥 9:30am MDT | Kiva Auditorium

During his keynote talk, NVIDIA鈥檚 Head of Quantum Computing Product, Sam Stanwyck, will detail our partnership to fast-track commercially scalable quantum supercomputers. Discover how 夜色直播 and NVIDIA are pushing the boundaries to deliver on the power of hybrid quantum and classical compute 鈥 from integrating NVIDIA鈥檚 CUDA-Q Platform with access to 夜色直播鈥檚 industry-leading hardware to the recently announced NVIDIA Quantum Research Center (NVAQC).

Featured Research at the IEEE Poster Session:

Visible Photonic Component Development for Trapped-Ion Quantum Computing
September 2nd from 6:30 - 8:00pm MDT | September 3rd from 9:30 - 10:00am MDT |聽September 4th from 11:30 - 12:30pm MDT
Authors: Elliot Lehman, Molly Krogstad, Molly P. Andersen, Sara Cambell, Kirk Cook, Bryan DeBono, Christopher Ertsgaard, Azure Hansen, Duc Nguyen, Adam聽Ollanik, Daniel Ouellette, Michael Plascak, Justin T. Schultz, Johanna Zultak, Nicholas Boynton, Christopher DeRose,Michael Gehl, and Nicholas Karl

Scaling Up Trapped-Ion Quantum Processors with Integrated Photonics
September 2nd from 6:30 - 8:00pm MDT and 2:30 - 3:00pm MDT |聽September 4th from 9:30 - 10:00am MDT

Authors: Molly Andersen, Bryan DeBono, Sara Campbell, Kirk Cook, David Gaudiosi, Christopher Ertsgaard, Azure Hansen, Todd Klein, Molly Krogstad, Elliot Lehman, Gregory MacCabe, Duc Nguyen, Nhung Nguyen, Adam Ollanik, Daniel Ouellette, Brendan Paver, Michael Plascak, Justin Schultz and Johanna Zultak

Research Collaborations with the Local Ecosystem

In a partnership that is part of a long-standing relationship with Los Alamos National Laboratory, we have been working on new methods to make quantum computing operations more efficient, and ultimately, scalable.

Learn more in our Research Paper:

Our teams collaborated with Sandia National Laboratories demonstrating our leadership in benchmarking. In this paper, we implemented a technique devised by researchers at Sandia to measure errors in mid-circuit measurement and reset. Understanding these errors helps us to reduce them while helping our customers understand what to expect while using our hardware.

Learn more in our Research Paper:

events
All
Blog
August 25, 2025
We鈥檙e not just catching up to classical computing, we鈥檙e evolving from it

From machine learning to quantum physics, tensor networks have been quietly powering the breakthroughs that will reshape our society. Originally developed by the legendary Nobel laureate Roger Penrose, they were first used to tackle esoteric problems in physics that were previously unsolvable.

Today, tensor networks have become indispensable in a huge number of fields, including both classical and quantum computing, where they are used everywhere from quantum error correction (QEC) decoding to quantum machine learning.

In , we teamed up with luminaries from the University of British Columbia, California Institute of Technology, University of Jyv盲skyl盲, KBR Inc, NASA, Google Quantum AI, NVIDIA, JPMorgan Chase, the University of Sherbrooke, and Terra Quantum AG to provide a comprehensive overview of the use of tensor networks in quantum computing.

Standing on the shoulders of giants

Part of what drives our leadership in quantum computing is our commitment to building the best scientific team in the world. This is precisely why we hired Dr. Reza Haghshenas, one of the world鈥檚 leading experts in tensor networks, and a co-author on the paper.

Dr. Haghshenas has been researching tensor networks for over a decade across both academia and industry. Dr. Haghshenas did postdoctoral work under , a leading figure in the use of tensor networks for quantum physics and chemistry.

鈥淲orking with Dr. Garnet Chan at Caltech was a formative experience for me鈥, remarked Dr. Haghshenas. 鈥淲hile there, I contributed to the development of quantum simulation algorithms and advanced classical methods like tensor networks to help interpret and simulate many-body physics.鈥

Since joining 夜色直播, Dr. Haghshenas has led projects that bring tensor network methods into direct collaboration with experimental hardware teams 鈥 exploring quantum magnetism on real quantum devices and helping demonstrate early signs of quantum advantage. He also contributes to , helping the broader research community access these methods.

Dr. Haghshenas鈥 work sits in a broad and vibrant ecosystem exploring novel uses of tensor networks. Collaborations with researchers like Dr. Chan at Caltech, and NVIDIA have brought GPU-accelerated tools to bear on the forefront of applying tensor networks to quantum chemistry, quantum physics, and quantum computing.

A powerful simulation tool

Of particular interest to those of us in quantum computing, the best methods (that we know of) for simulating quantum computers with classical computers rely on tensor networks. Tensor networks provide a nice way of representing the entanglement in a quantum algorithm and how it spreads, which is crucial but generally quite difficult for classical algorithms. In fact, it鈥檚 partly tensor networks鈥 ability to represent entanglement that makes them so powerful for quantum simulation. Importantly, it is our in-house expertise with tensor networks that makes us confident we are indeed moving past classical capabilities.

A theory of evolution

Tensor networks are not only crucial to cutting-edge simulation techniques. 聽At 夜色直播, we're working on understanding and implementing quantum versions of classical tensor network algorithms, from quantum matrix product states to holographic simulation methods. In doing this, we are leveraging decades of classical algorithm development to advance quantum computing.

A topic of growing interest is the role of tensor networks in QEC, particularly in a process known as decoding. QEC works by encoding information into an entangled state of multiple qubits and using syndrome measurements to detect errors. These measurements must then be decoded to identify the specific error and determine the appropriate correction. This decoding step is challenging鈥攊t must be both fast (within the qubit鈥檚 coherence time) and accurate (correctly identifying and fixing errors). Tensor networks are emerging as one of the most for tackling this task.

Looking forward (and backwards, and sideways...)

Tensor networks are more than just a powerful computational tool 鈥 they are a bridge between classical and quantum thinking. As this new paper shows, the community鈥檚 understanding of tensor networks has matured into a robust foundation for advancing quantum computing, touching everything from simulation and machine learning to error correction and circuit design.

At 夜色直播, we see this as an evolutionary step, not just in theory, but in practice. By collaborating with top minds across academia and industry, we're charting a path forward that builds on decades of classical progress while embracing the full potential of quantum mechanics. This transition is not only conceptual but algorithmic, advancing how we formulate and implement methods utilizing efficiently both classical and quantum computing. Tensor networks aren鈥檛 just helping us keep pace with classical computing; they鈥檙e helping us to transcend it.

technical
All