Oracle Separation of BQP and the Polynomial Hierarchy
Complexity theory organizes "efficient computation" around the polynomial hierarchy — the tower built by alternating and quantifiers over short certificates. When quantum computers arrived, the question was where quantum polynomial time, , sits in it. Factoring lives in but also in , so it settles nothing. Could every quantum algorithm be simulated somewhere in the hierarchy — is ? Intuition said no: interference feels nothing like nondeterministic guessing. Turning that into a theorem took twenty-five years. Because an unconditional separation would resolve monsters like versus , the achievable target is an oracle (relativized) separation: hand both classes the same black box and ask whether some forces . Aaronson (2010) distilled the problem to one query-complexity statement and named the hard instance: forrelation. The missing half — a classical lower bound matching the trivial quantum upper bound — was supplied by Ran Raz and Avishay Tal in 2018, welding query complexity to the Fourier analysis of Boolean functions. This article develops both halves with re-derived constants and explains why the result marks the outer boundary of relativizing proofs.
- Relative to a suitable oracle, a problem a quantum computer solves in one query lies outside the entire polynomial hierarchy: — the 2018 theorem of Raz and Tal.
- The witness is forrelation: decide whether are independent or whether is aligned with the Hadamard transform ; the statistic is .
- One quantum query reads it off — the amplitude returning to equals , so ; independent inputs give , forrelated give .
- The classical lower bound rests on Tal's Fourier-tail bound for : constant-depth circuits have exponentially small Fourier weight above degree , where the signal sits.
- It is an oracle separation: it does not prove in the real world, but rules out every relativizing proof of the reverse containment — strong evidence for super-polynomial quantum advantage.
- Key idea: forrelation is a global, high-Fourier-degree correlation a quantum computer evaluates in a single interference step, yet and circuits carry vanishing Fourier weight on precisely the high-order structure that separates the forrelated distribution from the independent one.
Forrelation — the normalized inner product of with the Hadamard transform of — is the amplitude a quantum computer reads off in one query, yet (hence ) circuits have negligible Fourier weight on the high-degree structure that separates the forrelated from the independent distribution.
Where this lives today
Forrelation sits where quantum complexity, circuit lower bounds, and quantum advantage meet. As a barrier result it reshaped strategy: since cannot be proved by any relativizing argument, settling the question demands non-relativizing methods — as taught for interactive proofs. It is the cleanest speedup defeating not just but the whole tower of , and has been sharpened into "raw" and -fold variants proving further separations; its proof technology — Tal's Fourier-tail bounds — now also feeds pseudorandom generators, low-degree learning, and average-case lower bounds. The open frontier is an unrelativized separation, which forrelation frames but, being a query result, cannot itself resolve.
The physical picture
Picture the oracle as a long Boolean string in two halves, and on ( entries). A quantum computer spreads a register over all addresses, stamps the phase everywhere at once, Hadamard-transforms that pattern into the spectrum , stamps , and folds back with a final Hadamard. The amplitude surviving on the all-zeros string is a global correlation of the two halves — the overlap of with — in one interference step. A machine sees only individual bits and must reconstruct this global statistic from local samples.
Why is this hard for the hierarchy? Because the signal lives at high Fourier degree. In the independent case the amplitude on is a sum of random signs cancelling to ; in the forrelated case they conspire to — a difference invisible to any low-degree polynomial, and an acceptance probability is essentially such a polynomial on its high levels. The Raz–Tal argument replaces the bits by weakly correlated Gaussians, interpolates between the distributions, and bounds how fast the acceptance probability moves by its Fourier weight at each degree — Tal's tail bound kills the high degrees where the signal lives, the small per-coordinate correlation the low ones. The next figure states the resource gap.
The core equations
The polynomial hierarchy is the classical yardstick: the union of levels , each adding one alternating quantifier over a poly-length string before a poly-time predicate. Level zero is , level one ; the tower captures everything reachable by constantly many guess-and-check rounds.
where: — level : alternating quantifiers then a poly-time predicate; — NP machines with an oracle . Reading: a language is in if it sits at some finite level; relative to an oracle each such language is a quasipolynomial-size, constant-depth circuit over the oracle bits — each quantifier a huge fan-in gate, constant alternation depth giving constant circuit depth. Forrelation is the statistic that separates the two worlds: for it is the normalized correlation of with . The prefactor makes — this is the amplitude the algorithm produces.
where: — Hadamard matrix entry, the mod-2 inner product; — orthonormal transform with (Parseval); . Reading: since , is the cosine between and — a correlation in , hence for-relation. The quantum algorithm is three Hadamards around two phase queries, making forrelation a measurement probability.
where: — -fold Hadamard, implementing ; — phase oracle. Reading: a single query suffices, and the decision version ( or ?) has constant bias because jumps from to . The classical bound is a distinguishing-advantage inequality: view the acceptance indicator as a multilinear function of the oracle bits, expand in the Fourier basis, and the advantage is controlled level by level.
where: — circuit acceptance indicator as a multilinear polynomial in the oracle bits; — Fourier weight above degree ; — per-coordinate correlation between . Reading: low degrees are suppressed by , so all hinges on high-degree weight — which the next bound crushes. Tal's Fourier-tail bound is the load-bearing input: a constant-depth circuit cannot hide Fourier mass at high degree.
where: — circuit size; — depth; — Fourier mass above degree , exponentially small once . Reading: for quasipoly size and constant depth the crossover degree is , so where forrelation stores its signal the circuit is blind. The query upper bound, circuit lower bound, and diagonalization over machines give the theorem.
where: — a random (or explicit) oracle encoding one forrelation instance per input length. Reading: no relativizing technique can prove , since it would have to hold in this oracle world, where it is false.
The goal is to prove exactly by tracking the state through the five-stage circuit , hiding nothing in a normalization. This is the entire quantum side of the separation: it must produce a number bounded by one whose square is a probability, which we confirm numerically on a small instance.
Step 1. Start in and apply the first Hadamard: , the uniform superposition over all addresses. Why: the only step that touches every oracle location at once — the global view a classical sampler lacks.
Step 2. Apply , giving , then the second Hadamard. Using , the amplitude on becomes . Why: the Hadamard turns the phase pattern into the amplitude pattern — the register now holds the spectrum of .
Step 3. Apply (coefficient on ), then the final Hadamard and read the amplitude on , which collects from every basis state: . Why: the last Hadamard performs the inner product automatically — interference on is exactly the correlation we wanted.
Step 4. Bound and check. Since , we get and . On (), ; aligning gives , — one query certifies forrelation with certainty. Why: a real constant, not in asymptotics; state-vector simulation reproduces amplitude exactly. *Verified: reproduced by state-vector simulation (, ); Parseval confirmed.*
Go deeper · Derivation B · 1 minThe forrelation gap — constant versus one over root N
The goal is to compute the typical size of in the two regimes and exhibit the constant-factor gap the quantum algorithm exploits: under the forrelation concentrates at , while under it is bounded away from zero. We do the second moment exactly for and the alignment estimate for — the -versus- gap that becomes the separation.
Step 1. Independent second moment. With independent i.i.d. , expand and take expectations. Why: the second moment is the natural scale of a mean-zero quantity, and independence makes it closed-form.
Step 2. Independence gives , , so only the diagonal survives (phase ): . Why: random signs kill every off-diagonal term, leaving terms out of — the is exact.
Step 3. So the RMS forrelation under is (about for ): independent oracles are un-forrelated. Why: the forrelated case must clear this noise floor, and the floor shrinks as grows, so the gap widens.
Step 4. Forrelated alignment. Take , so . Each is a normalized sum of signs, approximately standard Gaussian, so . Why: alignment replaces cancellation with a sum of absolute values — the same terms add coherently, lifting to a constant.
Step 5. The genuine Raz–Tal avoids exact alignment (not samplable as a valid oracle) and uses weakly correlated truncated Gaussians with a small , tuned so while only high-degree Fourier structure separates . Why: the constant gap must come from a legitimate, samplable distribution — a real oracle must realize it. *Verified: by Monte Carlo (: vs ; vs ; vs ); aligned (: ).*
Go deeper · Derivation C · 1 minWhy constant-depth circuits cannot tell the two distributions apart
The goal is to bound the advantage of any circuit — hence any relativized machine — in distinguishing from , showing it is for quasipolynomial size. The strategy is a Gaussian interpolation: connect the distributions by a one-parameter family, differentiate the acceptance probability along it, and control the derivative degree by degree with Tal's bound — the hard half of the theorem, and why it needed a Fourier-analytic breakthrough.
Step 1. Interpolate. Let be the multilinear extension of the acceptance function and embed both distributions in a family of -correlated Gaussians, giving and a truncation of . Then obeys . Why: "distinguish" becomes "integrate a derivative," localizing the advantage to how fast 's mean moves per unit correlation.
Step 2. Differentiate in the Fourier basis. With , only correlated coordinates contribute and , . Why: correlation propagates through a degree- monomial as a -fold product, so each extra degree costs another factor of the tiny signal.
Step 3. Cauchy–Schwarz per level gives — the bound of equation (4). Why: this replaces a sum over exponentially many subsets by a sum over the degrees, weighted by the circuit's Fourier mass.
Step 4. Apply Tal: is tiny once . Low degrees are killed by , high degrees by the tail bound. Why: the two suppressions overlap — no degree has both the distribution difference and the circuit weight large.
Step 5. Summing, for every quasipoly constant-depth circuit; since a relativized machine is exactly such a family, none distinguishes from . Why: the classical lower bound Aaronson conjectured in 2010 and Raz–Tal supplied. *Verified: structure follows Raz–Tal (2018/STOC 2019); the load-bearing input is Tal's Fourier-tail bound (CCC 2017). Confirm and the decay constant .*
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Independent oracle () | random are essentially un-forrelated; the amplitude on is a cancelling sum of random signs | |
| Forrelated oracle () | , up to | aligned with : the terms add coherently and one quantum query detects it |
| Quantum query complexity | a single query gives constant bias; the optimal quantum advantage (Aaronson–Ambainis) | |
| Classical randomized | queries | the best possible classical query bound — matched, so forrelation is the extremal separator |
| Polynomial hierarchy / | advantage | no quasipoly constant-depth circuit distinguishes ; the tower is blind |
| Deep circuits () | Tal's bound degrades | specific to constant depth; unbounded depth (e.g. ) is not separated this way |
Worked examples
1 · A forrelation instance by hand (confidence builder)
Take , , on the ordered points . Find , the forrelation with aligned , and ; then contrast an independent .
Step 1. Transform. With and : , , , . So — this is its own transform, with (Parseval).
Step 2. Aligned. Take : , so . By equation (3) the amplitude on is , hence : one query certifies the forrelated case with certainty.
Step 3. Independent contrast. For , , so ; for , , so . Independent forrelations scatter around with spread (large only because ). Aligned forr = 1, independent forr scatters as — the gap one query reads.
2 · The asymptotic gap and the query counts
Let . Using the verified moments, quantify the gap and the queries each model needs.
Step 1. Noise floor under : , so RMS forrelation is and . Under , (idealized ), giving — a bias of .
Step 2. Query counts: quantum ; classical randomized (a thousand-fold gap, growing as ); polynomial hierarchy — advantage , so no machine succeeds at all. Quantum 1, randomized , super-polynomial — the query gap is the separation.
Physics of the portrait
Forrelation is a single number that is at once a quantum amplitude, a Fourier correlation, and a complexity-theoretic separator — with a story running from 1993 to a 2018 proof.
Origins · 1 minforrelation and how this was discovered
The question was born with the field. In 1993 Ethan Bernstein and Umesh Vazirani defined and asked how it relates to the classical hierarchy; the evidence stayed soft, since Shor's factoring lives in yet also in and witnesses nothing. Scott Aaronson reframed the problem in 2010, reducing " versus relative to an oracle" to a query-complexity statement and naming the hard instance forrelation. He and Andris Ambainis proved (2015) that it optimally separates quantum from classical queries: one versus . But upgrading "classical" to the whole hierarchy required showing even circuits cannot tell the two distributions apart — a tool from harmonic analysis. Avishay Tal supplied it in 2017 with a sharp Fourier-tail bound, and in 2018 he and Ran Raz combined it with Gaussian interpolation to prove the advantage is : an oracle relative to which — the theorem the 1993 question had awaited for 25 years.
Going further
Texts and papers. Raz, Tal, Oracle Separation of BQP and PH, STOC 2019 / Theory of Computing 18 (2022) — main theorem · Aaronson, BQP and the Polynomial Hierarchy, STOC 2010 — reduction and conjecture · Aaronson, Ambainis, Forrelation, SIAM J. Comput. 47 (2018) — optimal query gap · Tal, Tight Bounds on the Fourier Spectrum of AC0, CCC 2017 — Fourier-tail bound · Bernstein, Vazirani, Quantum Complexity Theory, SIAM J. Comput. 26 (1997) · O'Donnell, Analysis of Boolean Functions (2014) — Fourier toolkit.
Provenance. Forrelation is standardized here to (so ), the amplitude-consistent normalization; a source variant with a prefactor differs by and is not the amplitude. Re-verified in this build: by state-vector simulation (, ); by Monte Carlo (); aligned . Main theorem: Raz–Tal (2018); Fourier-tail bound: Tal (2017); optimal gap vs : Aaronson–Ambainis (2018). Class facts (; relativized as quasipoly ) are standard.
Prerequisites. The Complexity Class BQP · BQP versus P, NP, PSPACE · Quantum Query Complexity · The Polynomial Method for Quantum Lower Bounds. Leads to. BQP is Contained in PP and PSPACE · Quantum Interactive Proofs (QIP).
Ask the tutor: Ask me to walk through the forrelation instance by hand, or to unpack how Tal's Fourier-tail bound turns constant depth into blindness to high-degree structure.
Does this theorem prove quantum computers can do something outside the polynomial hierarchy?
Only inside a black box. Raz and Tal prove for some oracle — relative to it, a one-query quantum problem escapes the entire hierarchy. In the real world the question is still open, and both classes sit inside , so nothing is broken outright. The value is as a barrier: no relativizing technique can ever show . It does not settle the real-world relationship — it tells you which proof methods cannot.
What exactly is forrelation, in one sentence?
Forrelation measures how much one function correlates with the Fourier (Hadamard) transform of another : , a number in near zero for independent and bounded away from zero when is aligned with — correlation after a Fourier transform. It matters because this quantity is exactly the amplitude a three-Hadamard, two-query circuit deposits on the all-zeros string, so a quantum computer evaluates it in one shot while hierarchy machines cannot.
Why does a single quantum query suffice when classical algorithms need √N?
Because the circuit computes a global transform of the whole oracle in one interference step: the two Hadamards turn the phase pattern into its full spectrum across all amplitudes at once, and the final inner product against lands on the all-zeros amplitude as . A classical algorithm reads individual bits; to estimate a global correlation of terms that is either or it must sample enough to beat the noise floor — provably queries. The advantage is evaluating a Fourier correlation versus sampling it.
What is Tal's Fourier-tail bound and why is it the crux of the proof?
A function's "Fourier weight at degree " measures how much of it lives in -wise interactions. Tal's 2017 bound says a size-, depth- constant-depth circuit has weight above degree at most — exponentially small once exceeds a polylogarithm. It is the crux because the two distributions differ only through high-degree structure (weighted by the tiny signal ); the circuit has almost no weight there, so it cannot feel the difference — the ingredient Aaronson lacked in 2010.
How does a query lower bound turn into a statement about an oracle?
By diagonalization. Encode one forrelation instance of size at each length ; the oracle is the concatenation and asks whether that instance is forrelated. The quantum bound puts for every choice. Each fixed machine is a quasipoly constant-depth circuit family, wrong at length with probability ; summing over the countably many machines (Borel–Cantelli), a random defeats all of them with probability one — and Raz–Tal also give an explicit construction.
Is forrelation related to quantum-supremacy experiments like random circuit sampling?
They share a moral but not a mechanism. Forrelation is a decision/query problem with a proven, extremal separation against a rich classical class (), so it is the cleanest certificate that quantum advantage defeats every strategy in the hierarchy, not just polynomial time. Random circuit and boson sampling are sampling problems whose hardness rests on different, often average-case conjectures. The link is that forrelation-style arguments underpin the belief that hierarchy-based heuristics cannot spoof those experiments — the structural backbone of why "somewhere in " is not enough to simulate a quantum device.