Quantum Feature Maps and Kernel Methods
Kernel methods sit at the heart of classical machine learning: instead of working with raw data, you map each point into a high-dimensional feature space via and learn a linear model there. The kernel trick is that a large family of algorithms — support vector machines chief among them — never touch the feature vectors, only their inner products . Quantum kernel methods add one remark: a quantum state is already a feature vector. A circuit on prepares in a -dimensional Hilbert space, and the computer estimates inner products in that exponentially large space. The payoff is a clean division of labour. The quantum device evaluates one object — the Gram matrix — and everything after is classical and convex: the SVM dual is a quadratic program with a unique optimum. With no non-convex landscape and no gradient estimation on the encoding circuit, kernel methods sidestep the barren-plateau pathology of variational classifiers. The prize would be a kernel provably hard to compute classically yet genuinely useful; the obstacle, established since 2019, is that raw expressibility is self-defeating — highly expressive embeddings make every off-diagonal entry collapse toward , needing exponentially many shots to resolve. Designing a quantum kernel is therefore an exercise in inductive bias, not in covering Hilbert space.
- A quantum feature map encodes a point into a state in a -dimensional Hilbert space — the quantum analogue of a classical feature map.
- The induced kernel is the overlap , positive-semidefinite and estimable by a swap-free overlap test.
- Learning factorizes: the quantum device builds the Gram matrix, a classical convex SVM does the rest — no barren plateaus, as the encoding has no trainable parameters.
- A rigorous exponential advantage exists (the discrete-log kernel of Liu, Arrasmith, Cerezo et al.), but it is the exception — most embeddings offer no proven separation.
- The dominant failure mode is exponential concentration: expressive embeddings pin off-diagonal values at (variance ), so distinguishing them costs shots and the model predicts the mean.
- Key idea: a circuit defines a feature map ; the quantum kernel is positive-definite and quantum-estimable, and every step of learning afterwards is convex and classical.
A quantum circuit defines a feature map ; the quantum kernel is a positive-definite kernel estimable by a quantum computer, and all subsequent learning is convex and classical.
Where this lives today
Quantum kernels are the most experimentally mature corner of quantum machine learning because they demand so little of the hardware: a fixed encoding, an overlap test, and a classical SVM. The Havlíček demonstration ran on IBM superconducting qubits; classifiers have since been benchmarked on trapped-ion and photonic platforms, and the projected quantum kernel of Huang et al. (2021) was studied at dozens of qubits, showing reduced-density-matrix kernels resist concentration far better than fidelity kernels. The theoretical frontier is inductive bias by construction: equivariant and geometric kernels bake data symmetries directly into , and bandwidth tuning rescales the encoding angles to interpolate between the trivial () and concentrated () regimes. The open problem is stark: outside the discrete-log construction there is no proven advantage for a natural learning problem, and concentration suggests generic embeddings never will. Whether a data-tailored quantum kernel can beat the best classical kernel on a problem people actually care about — rather than a cryptographically engineered one — is the field's central unanswered question.
The physical picture
A quantum kernel answers one question: how similar are two data points after the quantum computer has looked at them? Encode and as states; the probability they pass an overlap test is their similarity. Because the states live in dimensions this can encode correlations no efficient classical measure reproduces — yet you never build the feature vector, only estimate its overlaps. The first figure makes "similarity = overlap" one picture: a compute-uncompute circuit whose all-zeros probability is the kernel entry, with the geometric view of two feature states at an angle.
Two regimes bracket the design space. A weak, low-expressibility embedding gives an essentially classical similarity and no advantage. A maximally expressive one makes the encoded states behave like independent Haar-random vectors, so for the overlap collapses toward : the Gram matrix becomes a scaled identity and the SVM memorizes rather than generalizes. The collapse is exponential in qubit count — the kernel sibling of the barren plateau. The punchline figure plots the mean off-diagonal value against qubit number, putting real numbers on the cliff.
The core equations
A fixed unitary maps a classical vector to a quantum state; its outer product is the density matrix that serves as feature vector in operator space.
where: — classical data point, ; — data-encoding unitary, parameters fixed to functions of the data; — qubit count, feature-space dimension ; — pure-state density matrix. Reading: the data enter only through , once, with nothing to train. The kernel is the overlap of two feature states; as a Hilbert–Schmidt inner product of density matrices it is a genuine positive-definite kernel.
where: — symmetric, positive-semidefinite kernel in ; — trace over the -qubit Hilbert space. Reading: this is the fidelity of the two pure states — when they coincide, when orthogonal. A quantum computer estimates equation (2) with no swap test and no ancilla: run , then the inverse , and read the register.
where: — compute-uncompute circuit on ; — probability every qubit returns to . Reading: the kernel is an outcome probability, so it inherits binomial shot statistics. Each shot is a Bernoulli trial, so one Gram entry has a binomial estimator whose variance sets the cost.
where: — shots per entry; — empirical estimate. Reading: precision costs per entry, and a Gram matrix has entries. With the Gram matrix in hand, learning is the ordinary soft-margin SVM dual — a convex quadratic program the quantum device never touches.
where: — dual variables (support-vector weights); — labels; — soft-margin regularization. Reading: because this is convex with a unique optimum; the decision function is . The failure mode dominating practice is a moment calculation: when the embedding forms an approximate unitary 2-design, the off-diagonal kernel concentrates with exponentially small variance.
where: — mean and variance over the input distribution. Reading: the mean off-diagonal value and the standard deviation both scale as , the variance as ; resolving the structure costs shots. A representative conjectured-hard embedding is the Havlíček ZZ feature map: Hadamards followed by data-dependent diagonal phases coupling qubits.
where: — data-dependent angle on qubit subset ; — Pauli-; — Hadamard layer. Reading: the nonlinear products imprint data correlations; estimating the kernel is conjectured (not proven) hard classically. Separately, any fixed-encoding variational model is linear in the feature state, hence a kernel model — developed in Derivation 3.
The goal is to prove the swap-free overlap test of equation (3) really estimates a positive-semidefinite kernel, so the SVM dual (5) is a legitimate convex program and not a heuristic. We connect three layers — the feature map into operator space, the Hilbert–Schmidt inner product that makes it an inner-product space, and the measurement frequency the hardware returns — then show the Gram matrix is automatically PSD, which licenses every downstream claim of convexity.
Step 1. Define the feature map into the real vector space of Hermitian operators with inner product . Why: a function is a valid kernel exactly when it is an inner product in some feature space, so name that space — here operator space, not state space.
Step 2. Evaluate the overlap. Since , the cyclic trace gives , real and non-negative. Why: this turns an abstract operator overlap into the squared amplitude of a single transition — what a computational-basis measurement reports.
Step 3. Read that amplitude off the hardware. Preparing and measuring yields with probability exactly , estimated by the all-zeros frequency over shots. Why: it collapses overlap estimation into one circuit and one bit-pattern count, making the protocol NISQ-friendly.
Step 4. Establish positive semidefiniteness. For any real , , a squared operator norm. Why: a Gram matrix of vectors in an inner-product space is PSD by construction, so the SVM dual is convex however exotic the feature space — convexity is inherited, not assumed. *Verified: cyclic-trace identity and Gram-matrix positivity are standard (Nielsen & Chuang ch. 2); the single-qubit check confirms the overlap-test value.*
Go deeper · Derivation B · 1 minExponential concentration from Haar-random embeddings
The goal is to show quantitatively why maximizing expressibility is self-defeating: when the ensemble approximates a unitary 2-design, the kernel goes statistically flat — off-diagonal entries pinned near one value with an exponentially small spread — so resolving the structure a classifier needs costs exponentially many measurements. We compute the mean and variance from the 2-design moments, then translate the variance into a shot budget — the calculation that earns concentration its name as the kernel analogue of barren plateaus.
Step 1. Model the embedding as Haar-random: with independent Haar-random unitaries, so are independent Haar-random pure states in dimension . Why: a maximally expressive encoding spreads inputs like random states, and the first two Haar moments give the mean and variance.
Step 2. First moment: . Why: two independent random unit vectors in dimensions have expected squared overlap — the value every off-diagonal entry is dragged toward.
Step 3. Second moment (Weingarten): , so . Why: this exact expression is what the asymptotics rest on — getting the exponent right is the whole point.
Step 4. Asymptotics: for large , , so — the same scale as the mean; a loose bound is . Why: mean and fluctuation shrink at the same rate, burying the contrast at scale — note variance goes as , not , which the thin migrated draft stated loosely.
Step 5. Shot budget: an off-diagonal has estimator variance , so standard error ; resolving needs . Why: below this the estimated Gram matrix is indistinguishable from a scaled identity and the model predicts the class mean — inductive bias, not expressibility, is the target. *Verified numerically: at , and , confirming ; matches Thanasilp et al. (2024) and Watrous ch. 7.*
Go deeper · Derivation C · 1 minWhy a variational quantum classifier is secretly a kernel machine
The goal is to establish Schuld's structural theorem — that every variational quantum model whose data enter only through a fixed feature map is at most as powerful as the kernel method built from that map — and so explain why the kernel is the theoretical ceiling of fixed-encoding quantum machine learning. The argument identifies the variational output as linear in the feature state, then invokes the representer theorem to collapse the optimal operator onto the span of the training data.
Step 1. Write the variational output as an inner product. A fixed-encoding classifier applies a trainable and measures a fixed , giving with . Why: this exposes the model as strictly linear in the feature state — all nonlinearity lives in the fixed encoding, none in the readout.
Step 2. Apply the representer theorem. Minimizing any regularized empirical risk over forces the optimum into the span of the training states, , so . Why: the component of orthogonal to the training states only raises the regularizer, so it is discarded — the classical representer argument in operator space.
Step 3. Draw the consequence. The best fixed-encoding variational model coincides with a kernel model on the same embedding, so the kernel upper-bounds it — kernels are the best case for a given feature map. Why: a fixed-encoding model can only approach the kernel it already implies, so effort should go into the embedding, not a fancier readout. *Verified: linearity of in is immediate from the trace; the representer step is standard (Schölkopf & Smola ch. 4), and the conclusion is Schuld, arXiv:2101.11020 (2021).*
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Identical inputs | the fidelity kernel's diagonal is always one, fixing the Gram-matrix scale | |
| Maximally expressive (2-design) embedding | off-diagonals concentrate exponentially; resolving them needs shots — the barren-plateau analogue | |
| Product (separable) embedding | factorizable, classically efficient — no entanglement, no advantage, but no concentration | |
| Single-qubit encoding | a smooth classical shift-invariant kernel — a shallow map is trivially classical | |
| Projected / classical-shadow kernel | one-qubit marginals restore an scale, mitigating concentration (Huang et al. 2021) |
Worked examples
1 · A single-qubit kernel worked out by hand (confidence builder)
Encode a scalar with . Find the kernel in closed form, evaluate it at , and say why this embedding offers no advantage.
Step 1. Feature state: , tracing a great circle of the Bloch sphere as runs over .
Step 2. Overlap: , hence — a smooth, shift-invariant classical kernel a pocket calculator matches.
Step 3. Evaluate. At : , confirmed by the overlap test giving . A single qubit (and any tensor-product encoding) yields a factorizable kernel computable in classical operations, so there is no advantage — that requires entangling encodings whose overlaps resist classical evaluation. at the quarter-turn separation, classically trivial.
2 · Shot budget for one Gram matrix (fully numeric)
Target each off-diagonal entry to precision at 95% confidence, on points. How many shots per entry, and how many total?
Step 1. Per-entry shots from Hoeffding: gives . With : .
Step 2. The Gram matrix is symmetric with unit diagonal, so only off-diagonal entries need measuring.
Step 3. Total: shots. At circuits/s that is 2.5 hours of quantum time, scaling as — the wall the method hits on large datasets. Kernel methods trade the barren-plateau training problem for a quadratic-in- sampling one; if the embedding is also expressive, concentration adds an exponential factor (at the signal needs shots per entry, so it is unlearnable).
Physics of the portrait
A young idea with deep roots: the quantum feature map grafts the kernel trick onto the state space of a quantum computer, inheriting its convex guarantees and a failure mode all its own.
Origins · 1 minquantum feature map and how this was discovered
The quantum feature map arrived almost fully formed in 2019 from two directions. Maria Schuld and Nathan Killoran argued that a state-preparation circuit is a feature map into a "feature Hilbert space"; the same year, Vojtěch Havlíček and collaborators at IBM ran both a variational and a kernel-estimation classifier on superconducting hardware and conjectured their ZZ embedding yields classically hard kernels. The abstraction rests on older machinery — the kernel trick of Aizerman, Braverman and Rozonoer (1964) and the support vector machine of Boser, Guyon and Vapnik (1992) — with quantum information adding a feature space of dimension reachable by a device that never writes the feature vector down. Two 2021 results set the field's shape: Liu, Arrasmith, Cerezo and co-workers gave the first — and essentially only — rigorous exponential separation, whose classical solution would break the discrete-logarithm assumption; and Schuld proved every fixed-encoding variational model is a kernel method in disguise. The counter-melody, definitively from Thanasilp, Wang, Cerezo and Holmes (2024), is that expressive embeddings suffer exponential concentration, so the design problem is one of inductive bias, not raw quantum reach — the map that began as an optimistic analogy is now a delicate instrument.
Going further
Texts and papers. Havlíček et al., "Supervised learning with quantum-enhanced feature spaces", Nature 567, 209 (2019) · Schuld & Killoran, "Quantum machine learning in feature Hilbert spaces", PRL 122, 040504 (2019) · Liu, Arrasmith, Cerezo et al., "A rigorous and robust quantum speed-up in supervised machine learning", Nature Physics 17, 1013 (2021) · Schuld, "Supervised quantum machine learning models are kernel methods", arXiv:2101.11020 (2021) · Huang et al., "Power of data in quantum machine learning", Nature Communications 12, 2631 (2021) · Kübler, Buchholz & Schölkopf, "The inductive bias of quantum kernels", NeurIPS (2021) · Thanasilp, Wang, Cerezo & Holmes, "Exponential concentration in quantum kernel methods", Nature Communications 15, 5200 (2024) · Schölkopf & Smola, Learning with Kernels (MIT Press, 2002) · Nielsen & Chuang, Quantum Computation and Quantum Information (10th anniv. ed.); Watrous, The Theory of Quantum Information, ch. 7 (Haar/Weingarten calculus).
Provenance. A verifier should recompute: (1) the cyclic-trace identity and Gram-matrix PSD-ness (Nielsen & Chuang ch. 2); (2) the Haar moments , , giving with — note variance goes as , not (Watrous ch. 7; Thanasilp et al. 2024); (3) the Hoeffding budget at ; (4) the kernel at . Structural claims about the ZZ map, the discrete-log separation, and concentration are cited from the primary sources; no experimental numbers are fabricated.
Prerequisites. Quantum Machine Learning Models · Parameterized Quantum Circuits and Ansatz Design · Cost-Function and Measurement Estimation · Expressibility and Trainability Trade-offs. Leads to. Variational Quantum Eigensolver · Barren Plateaus · Mitigating Barren Plateaus.
Ask the tutor: Ask me to walk through why a maximally expressive embedding concentrates to , or to derive the single-qubit kernel from scratch.
Is a quantum kernel just a fancy classical kernel, or something genuinely different?
Formally it is an ordinary positive-definite kernel — that is the appeal, because it plugs straight into a classical SVM with the convexity intact. Only the cost of computing it can differ. A shallow or product embedding has a closed classical form (Worked Example 1), so no advantage; the hope is an entangling embedding whose overlaps are classically intractable, of which the discrete-log kernel is a proven case. A quantum kernel is not a new kind of similarity — just a possibly-hard-to-evaluate instance of a familiar one.
Why do kernel methods avoid barren plateaus when variational classifiers do not?
Because the encoding circuit carries no trainable parameters. Barren plateaus are about gradients of a trainable circuit vanishing across a non-convex landscape; a kernel method has no such landscape — the device only does forward overlap estimations, and the sole optimization is the convex SVM dual. But the difficulty does not vanish, it moves: exponential concentration is the kernel sibling of the barren plateau — a flat kernel and unresolvable Gram entries.
What actually is the exponential concentration problem, in one paragraph?
For an expressive embedding behaving like a unitary 2-design, every off-diagonal entry is dragged toward , with spread across data pairs of standard deviation only (variance ). So the contrast a classifier lives on is exponentially small. Seeing it above shot noise takes shots per entry; below that the estimated Gram matrix is a scaled identity and the SVM predicts the class mean. It is why "use all of Hilbert space" is a trap.
Is there a proven quantum advantage for kernel methods, or just hope?
Exactly one clean proof, and much hope. Liu, Arrasmith, Cerezo et al. (2021) built a problem whose labels depend on the discrete logarithm of the input; a feature map from modular-exponentiation circuits yields a kernel an efficient quantum SVM learns well, while any classical learner beating chance would give an efficient discrete-log solver, contradicting a standard cryptographic assumption. That is a rigorous exponential separation — but engineered around a problem chosen to be hard, not a dataset anyone needs classified. For natural problems no proven advantage exists: it is possible in principle, unproven in practice.
How is a quantum kernel estimated without a swap test?
You use the compute-uncompute (inversion) test. For , prepare , apply , then the inverse , and measure. The all-zeros probability is exactly , estimated by the frequency over shots. No ancilla and no controlled-SWAP, so it roughly halves qubit count and depth versus a swap test — the NISQ default. The catch: it needs a clean , and any coherent error in the inverse degrades the estimate.
If expressibility is bad, why not just use a trivial low-expressibility encoding?
Because a trivial encoding gives a trivial, classically computable kernel with no chance of advantage — the two failure modes bracket a narrow useful window. Too little expressibility and the kernel is a plain classical similarity (Worked Example 1); too much and it concentrates to uselessness (Derivation 2). The art is structured expressibility: rich enough that overlaps are classically hard, yet restricted by inductive bias — symmetry, locality, tuned bandwidth — so similar data stay measurably more similar, the classical lesson that the right kernel encodes prior knowledge.