Quantum annealing

Short description: Quantum physics-based metaheuristic for optimization problems

Quantum annealing (QA) is an optimization process for finding the global minimum of a given objective function over a given set of candidate solutions (candidate states), by a process using quantum fluctuations. Quantum annealing is used mainly for problems where the search space is discrete (combinatorial optimization problems) with many local minima; such as finding the ground state of a spin glass or the traveling salesman problem. The term "quantum annealing" was first proposed in 1988 by B. Apolloni, N. Cesa Bianchi and D. De Falco as a quantum-inspired classical algorithm. It was formulated in its present form by T. Kadowaki and H. Nishimori (ja) in 1998 though an imaginary-time variant without quantum coherence had been discussed by A. B. Finnila, M. A. Gomez, C. Sebenik and J. D. Doll in 1994.

Quantum annealing starts from a quantum-mechanical superposition of all possible states (candidate states) with equal weights. Then the system evolves following the time-dependent Schrödinger equation, a natural quantum-mechanical evolution of physical systems. The amplitudes of all candidate states keep changing, realizing a quantum parallelism, according to the time-dependent strength of the transverse field, which causes quantum tunneling between states or essentially tunneling through peaks. If the rate of change of the transverse field is slow enough, the system stays close to the ground state of the instantaneous Hamiltonian (also see adiabatic quantum computation). If the rate of change of the transverse field is accelerated, the system may leave the ground state temporarily but produce a higher likelihood of concluding in the ground state of the final problem Hamiltonian, i.e., diabatic quantum computation. The transverse field is finally switched off, and the system is expected to have reached the ground state of the classical Ising model that corresponds to the solution to the original optimization problem. An experimental demonstration of the success of quantum annealing for random magnets was reported immediately after the initial theoretical proposal. Quantum annealing has also been proven to provide a fast Grover oracle for the square-root speedup in solving many NP-complete problems.

Comparison to Simulated Annealing

Quantum annealing can be compared to simulated annealing, whose "temperature" parameter plays a similar role to QA's tunneling field strength. In simulated annealing, the temperature determines the probability of moving to a state of higher "energy" from a single current state. In quantum annealing, the strength of transverse field determines the quantum-mechanical probability to change the amplitudes of all states in parallel. Analytical and numerical evidence suggests that quantum annealing outperforms simulated annealing under certain conditions (see for a careful analysis, and, for a fully solvable model of quantum annealing to arbitrary target Hamiltonian and comparison of different computation approaches).

Quantum mechanics: analogy and advantage

Quantum Annealing (blue line) efficiently traverses energy landscapes by leveraging quantum tunneling to find the global minimum. Quantum annealing offers a significant performance advantage over Simulated Annealing (magenta line), unlocking the potential to solve massive optimization problems previously thought to be impossible.

The tunneling field is basically a kinetic energy term that does not commute with the classical potential energy part of the original glass. The whole process can be simulated in a computer using quantum Monte Carlo (or other stochastic technique), and thus obtain a heuristic algorithm for finding the ground state of the classical glass.

In the case of annealing a purely mathematical objective function, one may consider the variables in the problem to be classical degrees of freedom, and the cost functions to be the potential energy function (classical Hamiltonian). Then a suitable term consisting of non-commuting variable(s) (i.e. variables that have non-zero commutator with the variables of the original mathematical problem) has to be introduced artificially in the Hamiltonian to play the role of the tunneling field (kinetic part). Then one may carry out the simulation with the quantum Hamiltonian thus constructed (the original function + non-commuting part) just as described above. Here, there is a choice in selecting the non-commuting term and the efficiency of annealing may depend on that.

It has been demonstrated experimentally as well as theoretically, that quantum annealing can indeed outperform thermal annealing (simulated annealing) in certain cases, especially where the potential energy (cost) landscape consists of very high but thin barriers surrounding shallow local minima. Since thermal transition probabilities (proportional to [math]\displaystyle{ e^{-\frac{\Delta}{k_B T}} }[/math], with [math]\displaystyle{ T }[/math] the temperature and [math]\displaystyle{ k_B }[/math] the Boltzmann constant) depend only on the height [math]\displaystyle{ \Delta }[/math] of the barriers, for very high barriers, it is extremely difficult for thermal fluctuations to get the system out from such local minima. However, as argued earlier in 1989 by Ray, Chakrabarti & Chakrabarti, the quantum tunneling probability through the same barrier (considered in isolation) depends not only on the height [math]\displaystyle{ \Delta }[/math] of the barrier, but also on its width [math]\displaystyle{ w }[/math] and is approximately given by [math]\displaystyle{ e^{-\frac{\sqrt{\Delta} w}{\Gamma}} }[/math], where [math]\displaystyle{ \Gamma }[/math] is the tunneling field. This additional handle through the width [math]\displaystyle{ w }[/math], in presence of quantum tunneling, can be of major help: If the barriers are thin enough (i.e. [math]\displaystyle{ w \ll \sqrt{\Delta} }[/math]), quantum fluctuations can surely bring the system out of the shallow local minima. For an [math]\displaystyle{ N }[/math]-spin glass, the barrier height [math]\displaystyle{ \Delta }[/math] becomes of order [math]\displaystyle{ N }[/math]. For constant value of [math]\displaystyle{ w }[/math] one gets [math]\displaystyle{ \tau }[/math] proportional to [math]\displaystyle{ e^{\sqrt{N}} }[/math] for the annealing time (instead of [math]\displaystyle{ \tau }[/math] proportional to [math]\displaystyle{ e^N }[/math] for thermal annealing), while [math]\displaystyle{ \tau }[/math] can even become [math]\displaystyle{ N }[/math]-independent for cases where [math]\displaystyle{ w }[/math] decreases as [math]\displaystyle{ 1/\sqrt{N} }[/math].

It is speculated that in a quantum computer, such simulations would be much more efficient and exact than that done in a classical computer, because it can perform the tunneling directly, rather than needing to add it by hand. Moreover, it may be able to do this without the tight error controls needed to harness the quantum entanglement used in more traditional quantum algorithms. Some confirmation of this is found in exactly solvable models.

Timeline of ideas related to quantum annealing in Ising spin glasses:

• 1989 Idea was presented that quantum fluctuations could help explore rugged energy landscapes of the classical Ising spin glasses by escaping from local minima (having tall but thin barriers) using tunneling;
• 1998 Formulation of quantum annealing and numerical test demonstrating its advantages in Ising glass systems;
• 1999 First experimental demonstration of quantum annealing in LiHoYF Ising glass magnets;
• 2011 Superconducting-circuit quantum annealing machine built and marketed by D-Wave Systems.

D-Wave implementations

Photograph of a chip constructed by D-Wave Systems, mounted and wire-bonded in a sample holder. The D-Wave One's processor is designed to use 128 superconducting logic elements that exhibit controllable and tunable coupling to perform operations.

In 2011, D-Wave Systems announced the first commercial quantum annealer on the market by the name D-Wave One and published a paper in Nature on its performance. The company claims this system uses a 128 qubit processor chipset. On May 25, 2011, D-Wave announced that Lockheed Martin Corporation entered into an agreement to purchase a D-Wave One system. On October 28, 2011 USC's Information Sciences Institute took delivery of Lockheed's D-Wave One.

In May 2013 it was announced that a consortium of Google, NASA Ames and the non-profit Universities Space Research Association purchased an adiabatic quantum computer from D-Wave Systems with 512 qubits. An extensive study of its performance as quantum annealer, compared to some classical annealing algorithms, is already available.

In June 2014, D-Wave announced a new quantum applications ecosystem with computational finance firm 1QB Information Technologies (1QBit) and cancer research group DNA-SEQ to focus on solving real-world problems with quantum hardware. As the first company dedicated to producing software applications for commercially available quantum computers, 1QBit's research and development arm has focused on D-Wave's quantum annealing processors and has successfully demonstrated that these processors are suitable for solving real-world applications.

With demonstrations of entanglement published, the question of whether or not the D-Wave machine can demonstrate quantum speedup over all classical computers remains unanswered. A study published in Science in June 2014, described as "likely the most thorough and precise study that has been done on the performance of the D-Wave machine" and "the fairest comparison yet", attempted to define and measure quantum speedup. Several definitions were put forward as some may be unverifiable by empirical tests, while others, though falsified, would nonetheless allow for the existence of performance advantages. The study found that the D-Wave chip "produced no quantum speedup" and did not rule out the possibility in future tests. The researchers, led by Matthias Troyer at the Swiss Federal Institute of Technology, found "no quantum speedup" across the entire range of their tests, and only inconclusive results when looking at subsets of the tests. Their work illustrated "the subtle nature of the quantum speedup question". Further work has advanced understanding of these test metrics and their reliance on equilibrated systems, thereby missing any signatures of advantage due to quantum dynamics.

There are many open questions regarding quantum speedup. The ETH reference in the previous section is just for one class of benchmark problems. Potentially there may be other classes of problems where quantum speedup might occur. Researchers at Google, LANL, USC, Texas A&M, and D-Wave are working to find such problem classes.

In December 2015, Google announced that the D-Wave 2X outperforms both simulated annealing and Quantum Monte Carlo by up to a factor of 100,000,000 on a set of hard optimization problems.

D-Wave's architecture differs from traditional quantum computers. It is not known to be polynomially equivalent to a universal quantum computer and, in particular, cannot execute Shor's algorithm because Shor's algorithm is not a hillclimbing process. Shor's algorithm requires a universal quantum computer. During the Qubits 2021 conference held by D-Wave, it was announced that the company is hard at work developing their first universal quantum computers, capable of running Shor's algorithm in addition to other gate-model algorithms such as QAOA and VQE.

"A cross-disciplinary introduction to quantum annealing-based algorithms" presents an introduction to combinatorial optimization (NP-hard) problems, the general structure of quantum annealing-based algorithms and two examples of this kind of algorithms for solving instances of the max-SAT and Minimum Multicut problems, together with an overview of the quantum annealing systems manufactured by D-Wave Systems. Hybrid quantum-classic algorithms for large-scale discrete-continuous optimization problems were reported to illustrate the quantum advantage.

Further reading

• Bapst, V.; Foini, L.; Krzakala, F.; Semerjian, G.; Zamponi, F. (2013). "The quantum adiabatic algorithm applied to random optimization problems: The quantum spin glass perspective". Physics Reports 523 (3): 127–205. doi:10.1016/j.physrep.2012.10.002. Bibcode: 2013PhR...523..127B. 
• Chandra, Anjan K.; Das, Arnab; Chakrabarti, Bikas K., eds (2010). Quantum Quenching, Annealing and Computation. Lecture Note in Physics. 802. Heidelberg: Springer. ISBN 978-3-64211-469-4. 
• Das, Arnab; Chakrabarti, Bikas K., eds (2005). Quantum Annealing and Related Optimization Methods. Lecture Note in Physics. 679. Heidelberg: Springer. ISBN 978-3-54027-987-7. 
• Dutta, A.; Aeppli, G.; Chakrabarti, B. K.; Divakaran, U.; Rosenbaum, T.F.; Sen, D. (2015). Quantum Phase Transitions in Transverse Field Spin Models: From Statistical Physics to Quantum Information. Cambridge & Delhi: Cambridge University Press. ISBN 978-1-10706-879-7. http://www.cambridge.org/us/academic/subjects/physics/quantum-physics-quantum-information-and-quantum-computation/quantum-phase-transitions-transverse-field-spin-models-statistical-physics-quantum-information. 
• Li, Fuxiang; Chernyak, V. Y.; Sinitsyn, N. A. (2013). "Quantum Annealing and Computation: A Brief Documentary Note". Science and Culture 79: 485–500. Bibcode: 2013arXiv1310.1339G. .
• Suzuki, S.; Inoue, J.-I.; Chakrabarti, B. K. (2013). "Chapter 8 on Quantum Annealing". Quantum Ising Phases & Transitions in Transverse Ising Models (2nd ed.). Heidelberg: Springer. ISBN 978-3-64233-038-4. 
• Tanaka, S.; Tamura, R.; Chakrabarti, B. K. (2017). Quantum Spin Glasses, Annealing & Computation. Cambridge & Delhi: Cambridge University Press. ISBN 978-1-10711-319-0. http://www.cambridge.org/us/academic/subjects/physics/condensed-matter-physics-nanoscience-and-mesoscopic-physics/quantum-spin-glasses-annealing-and-computation?format=HB#EsrdfXLEbPQs0trI.97. 
• "Quantum Annealing & Computation: Challenges & Perspectives". Philosophical Transactions A (Royal Society, London) 381. January 2023. https://royalsocietypublishing.org/toc/rsta/2023/381/2241.