Classical Surrogates and Dequantization of Variational Models
A variational quantum model earns its keep only if no efficient classical algorithm reproduces its outputs. That one sentence organizes an entire subfield. VQE ansätze, QAOA circuits, and quantum-machine-learning feature maps all advertise advantage by living in a Hilbert space of dimension — but advertising is not proof. The study of classical surrogates and dequantization asks, precisely: for which trained or trainable circuits can a classical algorithm running in time match the outputs to accuracy ? Two distinct programmes answer it. Surrogation builds a classical function mimicking the expectations a circuit produces, exploiting that any expectation value is a trigonometric polynomial in the gate angles whose Fourier support is shrunk by locality or concentration. Dequantization, in Ewin Tang's linear-algebra sense, observes that if a quantum routine's speedup comes only from low-rank structure read in superposition, a classical algorithm with -norm sample-and-query access matches it up to polynomial overhead. The lesson is sobering. Constant-depth circuits, symmetry-restricted ansätze, and barren-plateau-flattened landscapes are all already classically tractable — the structure that makes a model trainable tends to make it simulable. Genuine advantage survives only in a narrow band this article maps: an exponentially rich, untruncated spectrum that nonetheless keeps its gradients alive.
- A classical surrogate reproduces a trained model's input–output behaviour to accuracy ; dequantization is a provable classical algorithm matching a quantum routine's accuracy and runtime up to polynomial overhead.
- Every parameterized expectation value is a bounded-degree trigonometric polynomial in the gate angles, because each Pauli generator has eigenvalues and injects only frequencies per angle.
- Shallow light cones, low-degree spectra, Lie-restricted symmetry, and barren-plateau concentration each leave polynomially-many relevant Fourier modes — and therefore a classical surrogate.
- Tang-style dequantization collapses low-rank quantum speedups (recommendation, PCA, regression) to polynomial overhead once the classical baseline gets the fair sample-and-query access that mirrors state preparation.
- Classical simulability is the null hypothesis every advantage claim must defeat, and surrogates double as benchmarks, warm starts, and error-mitigation controls.
- Key idea: Every parameterized expectation value is a bounded-degree trigonometric polynomial in the gate angles; whenever locality, symmetry, or concentration forces this polynomial to have polynomially many relevant Fourier modes, the model is classically learnable and thus surrogable, so quantum advantage requires an exponentially rich, untruncated frequency spectrum that nonetheless remains trainable.
Where this lives today
Surrogation and dequantization are now standard equipment. Every serious advantage proposal is expected to survive its own surrogate — light-cone simulation for shallow ansätze, low-degree Fourier learning for bounded-spectrum cost functions, classical-shadow regression for feature maps — and several early speedup claims for quantum kernels and recommendation tasks were reframed once the matched baseline was run. Constructively, a trigonometric-polynomial fit from a few hundred parameter-shift evaluations is optimized classically to yield a warm-start in a region of large gradient, tying surrogation to barren-plateau mitigation, and a device that strays from its light-cone surrogate reveals its own error budget for zero-noise extrapolation. The open frontier is the second figure's narrow band: an ansatz with provably exponential, untruncated Fourier support whose gradients nonetheless stay — expressive, trainable, and provably hard to surrogate at once. No unconditional example is known, and finding one is among the central open problems of near-term quantum computing.
The physical picture
Picture a variational circuit as a box of knobs. Each knob enters through a rotation , and because the Pauli generator squares to the identity — eigenvalues — turning it can only make the output oscillate as and , never faster. The whole expectation value is therefore a finite sum of sines and cosines with integer frequencies — exactly, not approximately. If only polynomially many frequencies carry appreciable weight, you learn the function from polynomially many evaluations and store it in a classical table. That table is the surrogate, and the quantum device is redundant. Locality supplies the first reason the spectrum is small. An observable supported on a few qubits only feels the gates inside its backward light cone; in a constant-depth circuit that cone touches qubits, so the expectation depends on angles and can be computed by hand. The first figure makes this concrete for a real register.
Deep circuits with global entanglement break the light-cone argument — but they usually pay with a barren plateau, a landscape so flat the output concentrates around a fixed value a constant reproduces for free. The two easy regimes bracket the interesting one: too shallow and the cone is small, too deep and the landscape is flat. The second figure maps where surrogation succeeds and where advantage might still hide.
Dequantization flips a hidden assumption rather than a geometric one. A quantum algorithm reads an amplitude-encoded vector "for free" in superposition, while a naive classical algorithm seems forced to touch all entries. Grant the classical side sampling access — drawing index with probability — and importance sampling reproduces the same low-rank projections the quantum subroutine extracts. This access is the fair classical analogue of state preparation, and under it the recommendation, PCA, and regression speedups shrink to polynomial.
The core equations
A variational model output is the expectation value of a fixed observable in a parameterized state, built by interleaving fixed gates with single-parameter rotations — a scalar function of the angles.
where: — scalar cost or model output; — vector of tunable angles; — Pauli-string generator of the -th rotation, eigenvalues ; — fixed gates; — measured observable. The reading: everything trainable lives in , and the eigenstructure of the constrains how depends on it. Expanding each rotation and collecting terms shows is a multivariate trigonometric polynomial — a finite Fourier series with integer frequency vectors, each Pauli generator contributing only and to its own angle.
where: — frequency support, the set of active modes; — complex coefficient of mode ; — accumulated phase. The reading: surrogability is entirely about — a small or learnable support is a classical model. Because each angle carries a single frequency, its derivative is recovered exactly by two evaluations shifted by — the parameter-shift rule, at once the standard gradient estimator and the sharpest diagnostic of bounded frequency.
where: the shift is fixed by the unit frequency of a Pauli generator. The reading: an exact derivative from two points is only possible because is a single-frequency sinusoid in — the same fact that makes the global function learnable. Locality bounds the support geometrically. An observable evolves in the Heisenberg picture; only gates in its backward light cone change it, and on a bounded-degree graph that cone grows at a controlled rate with depth.
where: — circuit depth; — degree of the interaction graph; — qubits acts on; — sub-circuit inside the cone. The reading: gates outside cancel as , so is the expectation of a small sub-circuit, computable in time . When the landscape is flat, concentration replaces locality: Chebyshev's inequality turns an exponentially small variance into an exponentially good constant surrogate.
where: — the parameter-averaged value, equal to for a Pauli on a deep random circuit; — accuracy target. The reading: in a barren plateau the constant is a surrogate with mean-square error equal to the tiny variance. Dequantization replaces quantum amplitude access with a matched classical primitive: sample-and-query access, which draws indices from the squared-amplitude distribution and reads individual entries.
where: — a vector such as a matrix row; — its Euclidean norm, the analogue of a state-preparation amplitude. The reading: this is the fair baseline — without it the classical side is charged just to read the input, a spurious exponential gap. Finally, the surrogate one ships is a sparse Fourier series over a learned frequency set.
where: — dominant frequencies found by low-degree Fourier learning; — the surrogate. The reading: when the weight concentrates on modes, this series matches to with no quantum hardware.
The goal is to prove the structural fact on which the whole subject rests: that in equation (1) is a finite Fourier series with integer frequency vectors, with each angle contributing only the frequencies and . The argument uses nothing beyond the eigenstructure of a Pauli generator, so it holds for any ansatz built from Pauli rotations, and it yields the parameter-shift rule as a corollary rather than a separate trick.
Step 1. Expand a single rotation. Because for a Pauli string, the exponential's Taylor series collapses to . Why: even powers give cosines and odd powers give sines — no room for a higher harmonic.
Step 2. Conjugate an operator through the rotation in the Heisenberg picture: , splitting into commuting and anticommuting parts. Why: conjugation by a -eigenvalue generator produces only , , and constants — frequencies in that angle.
Step 3. Compose the angles. Evolving backward through all rotations multiplies factors each drawn from , whose products expand into a sum of exponentials with every — equation (2). Why: the support can never leave the integer box, so surrogability reduces to bounding how many modes carry weight.
Step 4. Read off the parameter-shift rule. Freezing all but leaves ; evaluating at and subtracting cancels and to give , equation (3). Why: the exactness of a two-point gradient is not a numerical accident but a certificate that each angle's frequency is at most one.
Go deeper · Derivation B · 1 minConstant-depth circuits are their own classical surrogate
The goal is to show that a shallow circuit on a bounded-degree connectivity graph, measured through a local observable, can be evaluated classically in time — so no advantage is possible there, and the circuit is literally its own surrogate. The argument combines the Heisenberg-picture cancellation from the previous derivation with a counting bound on how fast a causal cone can spread, and it is the workhorse that rules out advantage claims for many near-term ansätze.
Step 1. Write the expectation as backward evolution of the observable, with . Why: pushing through the layers, rather than propagating the state forward, exposes which gates can influence the result.
Step 2. Bound the causal cone. Each layer enlarges the operator's support by at most the graph degree , so ; on a D nearest-neighbour lattice this tightens to . Why: a gate only entangles qubits it directly couples, so the reachable set grows at a rate set by connectivity.
Step 3. Discard everything outside the cone. Any gate disjoint from the current operator commutes through and cancels as ; only the cone's gates, qubits, and angles survive, giving , equation (4). Why: most of the circuit is causally irrelevant to a local observable and is thrown away exactly, not approximately.
Step 4. Cost it. Exact simulation of the cone costs ; with , this is , and even on a bounded-degree graph stays . Why: this pins the boundary — depth must grow faster than logarithmically, or entanglement spread on an expander-like graph, before the surrogate fails.
Go deeper · Derivation C · 1 minTang-style dequantization of low-rank linear algebra
The goal is to show how a quantum algorithm whose only speedup is low-rank structure loses it once the classical baseline gets the fair sample-and-query access of equation (6). We build the matcher from importance sampling and a small Gram-matrix estimate, following the template Tang used to dequantize recommendation systems and, later, PCA and low-rank regression. The punchline: the advertised exponential gap was measured against an unfair baseline.
Step 1. Fix the access model. Grant : sample a row with probability and read chosen entries. Why: quantum algorithms assume amplitude encoding — a superposition weighted by entries — and is that assumption made classical, so comparing without it compares different problems.
Step 2. Estimate the Gram matrix by importance-weighted sub-sampling: draw rows and form , an unbiased estimator that, because rows are drawn by norm, captures high-weight directions with few samples (the FKV construction). Why: the top singular structure lives in a -dimensional subspace, and importance sampling concentrates samples exactly where it has weight.
Step 3. Diagonalize the small estimate to recover approximate top- singular values and vectors with spectral error , with high probability. Why: the heavy work is now on an object sized by and , not the ambient dimension where the exponential factor used to hide.
Step 4. Reconstruct the output by projecting the query vector onto the estimated subspace, reproducing the quantum answer to additive in time with no explicit . Why: the runtime depends on the ambient space only through norms and the condition number, so the exponential separation vanishes — it was never a property of the problem, only the baseline.
Limiting cases
Whether a variational model is surrogable is decided by which structural regime it occupies.
| Case | Result | Meaning |
|---|---|---|
| Constant depth, local observable | Cone touches qubits; depends on angles and is exactly, efficiently computable — the circuit is its own surrogate. | |
| Barren plateau | Output concentrates on ; the constant surrogate matches to — trivially dequantized. | |
| Low-degree spectrum | A bounded-degree trigonometric polynomial is learnable from samples by low-degree Fourier learning; surrogable. | |
| Low-rank linear algebra | Dequantized by sample-and-query: classical runtime , no -dependent exponential gap. | |
| Rich spectrum, live gradients | The conjectured advantage regime — exponential support and non-vanishing gradients together. No general surrogate is known; the genuine frontier. |
Worked examples
1 · Parameter-shift as a surrogability certificate (fully worked)
Take a single-angle model , the exact form any Pauli-rotation angle must produce. Recover its gradient from two evaluations, then count how many pin down the whole function — and how that explodes with the number of angles.
Step 1. Shifts at : and .
Step 2. Apply equation (3): . Calculus agrees: at . The two-point estimate is exact, not approximate — the signature of a single-frequency function.
Step 3. The function has three coefficients , so three evaluations (say ) fix it everywhere. That triple is the surrogate; the device is never queried again.
Step 4. Scale to angles: each carries frequencies , so the generic support has modes — for , coefficients, already intractable brute-force. Bounded degree alone is not enough; surrogability needs sparse or low-degree support — exactly what locality, symmetry, and concentration supply.
2 · Light-cone simulation cost (fully worked)
A single-qubit Pauli- observable is measured on a depth-, D nearest-neighbour brickwork circuit over qubits. How large is the backward light cone, and what does exact classical evaluation cost versus full state-vector simulation?
Step 1. On a D nearest-neighbour lattice the cone spreads by at most one qubit per side per layer, so qubits.
Step 2. Exact simulation of a -qubit sub-circuit costs amplitudes — trivial on a laptop.
Step 3. The naive route stores the full -qubit state: amplitudes, about petabytes — infeasible.
Step 4. The light cone buys a factor in memory. Any advantage claim here is dead on arrival: the model is its own polynomial-time surrogate, independent of training. (The complementary flat case — a plateau with — gives constant-surrogate error and needs shots to tell apart from the real model, exactly the cost that makes it untrainable.)
Physics of the portrait
Dequantization has an unusually crisp origin: a result produced by an undergraduate asked to prove the opposite.
Origins · 1 minEwin Tang and how this was discovered
Ewin Tang was an undergraduate at the University of Texas at Austin when Scott Aaronson set her a thesis problem: show that the quantum recommendation system of Kerenidis and Prakash — then one of the cleanest examples of exponential speedup for a practical task — could not be matched classically, certifying it as genuine advantage. After months of failing to prove hardness, she saw why: the classical baseline had the wrong tools. Granting it -norm sample-and-query access — the fair analogue of the quantum algorithm's amplitude encoding — she produced in 2018, at age eighteen, a classical algorithm with only polynomial overhead. The technique generalized fast: within a year she and collaborators had dequantized low-rank matrix inversion, PCA, and supervised clustering, and by 2020 a unified sample-and-query framework subsumed a whole family of "quantum-inspired" algorithms. Tang reframed the advantage question permanently — a linear-algebra speedup is real only if it survives a classical opponent with matched input access — making the fairness of the baseline the first thing any claim must settle.
Going further
References. Nielsen & Chuang, Quantum Computation and Quantum Information, 10th anniv. ed., ch. 4 & 8 (circuit model and simulation) · Preskill, Quantum Computing in the NISQ era and beyond, Quantum 2 (2018) 79 · Watrous, The Theory of Quantum Information (2018), chapters on channels and norms · Kitaev, Shen & Vyalyi, Classical and Quantum Computation (complexity foundations) · Tang, A quantum-inspired classical algorithm for recommendation systems, STOC 2019 · Schuld, Sweke & Meyer, The effect of data encoding on the expressive power of variational quantum models, PRA 103 (2021) 032430.
Provenance. The trigonometric-polynomial and parameter-shift structure follow from for Pauli generators (Nielsen & Chuang ch. 4; a verifier recomputes ). Light-cone simulability uses Heisenberg-picture cancellation with bounded-degree graph counting (standard; Kitaev–Shen–Vyalyi, Watrous). Barren-plateau surrogacy applies Chebyshev's inequality to design-averaged variance (Preskill NISQ notes; the MSE-equals-variance identity is elementary). Dequantization follows Tang-type sample-and-query with FKV low-rank sampling; a verifier checks unbiasedness and spectral concentration of the importance-sampled Gram estimate. The worked numbers (, , , , and the parameter-shift gradient ) are recomputed directly; for a traceless-corrected Pauli observable is the only tabulated relation and is standard.
Builds on. Parameterized Quantum Circuits and Ansatz Design · Parameter-Shift Rules and Quantum Gradients · Barren Plateaus in Variational Landscapes · Quantum Machine Learning Models. Leads to. Expressibility, Entangling Capability, and Trainability Trade-offs · Strategies to Mitigate Barren Plateaus · QAOA Performance Bounds and Concentration.
Ask the tutor: Ask me to walk through the parameter-shift gradient by hand, count the light cone of your own ansatz, or show exactly where a claimed quantum speedup would have to live to escape both surrogation and dequantization.
What is the difference between a classical surrogate and dequantization?
They answer the same worry from opposite directions. A classical surrogate is empirical: given a trained model, you fit a classical function — a sparse trigonometric-polynomial or classical-shadow regressor — reproducing its outputs to on the input distribution you care about. Dequantization is provable: you show a quantum speedup rested on low-rank structure and build a matched--access classical algorithm polynomial in the same parameters. Surrogation targets a model's outputs; dequantization targets an algorithm's runtime. Both conclude the device was unnecessary — one as a fitted approximation, the other as a complexity-theoretic guarantee.
If my circuit is provably hard to simulate, doesn't that guarantee quantum advantage?
No, and conflating the two is the field's most common mistake. Hardness of exact strong simulation means no classical algorithm can output arbitrary amplitudes efficiently — a statement about the full -dimensional object. A useful model, though, only needs to beat classical methods at reproducing its trained outputs on real inputs. A barren-plateau circuit can be -hard to simulate exactly yet be matched to sampling noise by a constant, because its outputs concentrate. Simulation hardness is necessary but nowhere near sufficient; you must also show the outputs resist every efficient surrogate.
Why do barren plateaus make a model easy to surrogate rather than hard?
Because a barren plateau is extreme flatness. When the gradient variance decays as , the output variance does too, so sits within an exponentially small window of its mean for almost every parameter. The simplest classical model — the constant — matches with mean-square error equal to that tiny variance. Telling the real model from the constant would take exponentially many shots, the same cost that makes the plateau untrainable. So the plateau kills training and hands you a trivial surrogate at once; no plateaued model is both useful and hard to reproduce.
What exactly does sample-and-query access give the classical algorithm?
Three abilities, all matched to quantum amplitude encoding. Sampling: draw an index with probability proportional to , mirroring a measurement of a state whose amplitudes track the entries. Query: read any chosen entry . Norm: return . Together they let a classical algorithm do importance sampling on a matrix's high-weight directions — enough to estimate top singular vectors by sub-sampling. The point is fairness: a quantum algorithm assuming an amplitude-encoded input is assuming exactly this access, so the honest comparison grants it too rather than charging the classical side to read the input.
Does dequantization mean quantum machine learning is pointless?
No — it means the bar is precise. Dequantization removed the exponential speedup only for algorithms whose advantage came solely from low-rank linear algebra via amplitude encoding, and even there a polynomial gap can remain. It says nothing about genuinely high-rank problems, sampling problems with no efficient classical analogue, or fault-tolerant algorithms like Shor's, which rest on different mechanisms. What it killed was one over-optimistic narrative; what it left is the harder question of which problems have structure classical access truly cannot exploit.
How is a surrogate actually built and stored in practice?
The common recipe exploits equation (7): collect a few hundred to a few thousand model evaluations — from the device or its trained parameters via parameter-shift — and fit a sparse Fourier series over a candidate frequency set , keeping only modes whose coefficients clear a threshold. The stored surrogate is that list of frequencies and coefficients, evaluated on a CPU in microseconds. For shallow circuits you instead store and simulate the light-cone sub-circuit; for feature maps you store a classical-shadow representation and regress against it. The deliverable is always a small classical file reproducing the outputs without quantum hardware.