Hidden Subgroup Problem
The Hidden Subgroup Problem is the organizing abstraction of quantum algorithmics — the single template from which nearly every exponential quantum speedup descends. You are handed black-box access to a function from a group into some set of labels , with one promise: there is a subgroup such that precisely when and lie in the same left coset of . In plain terms is constant on each coset and different across cosets, so hides inside its level sets. Your job is to expose — to output a generating set — with as few queries to and as few gates as possible. The reason this one problem matters is that so many famous algorithms are secretly the same algorithm. Take with of order two and you have Simon's problem. Take with and the hidden subgroup is , where is the multiplicative order of — so HSP becomes order finding, and hence Shor's factoring. Discrete logarithm is HSP over ; Deutsch–Jozsa and Bernstein–Vazirani are degenerate abelian cases. In every abelian instance the engine is identical: a single oracle call builds a coset state, the Quantum Fourier Transform over converts the coset's translational symmetry into a character orthogonal to , and a handful of such samples pins the subgroup down. The nonabelian version — dihedral, symmetric — is one of the great open problems of the field, tied to lattice cryptography and graph isomorphism. This article is the synthesis piece that its abelian children point back to.
- The Hidden Subgroup Problem: given that is constant on cosets of an unknown and distinct across them, output a generating set for .
- Almost every structured exponential quantum speedup is an abelian HSP — Deutsch–Jozsa, Bernstein–Vazirani, Simon, order finding, period finding, and discrete logarithm all fit the one template.
- The abelian recipe: one query prepares a coset state, the Quantum Fourier Transform over maps it onto the dual subgroup , and samples plus linear algebra recover .
- The duality is exact: and , so measured characters annihilating can be inverted back to itself.
- Nonabelian HSP is largely open — efficient algorithms exist only for special groups; the dihedral case reduces to worst-case lattice problems and the symmetric case to graph isomorphism.
- The obstruction is that weak Fourier sampling over higher-dimensional irreducible representations cannot separate conjugate hidden subgroups, so the naive quantum approach provably loses information for and .
- Key idea: a function constant on the cosets of a hidden subgroup encodes that subgroup's translational symmetry, and one query turns it into a coset state; for abelian the Fourier transform diagonalizes translations, so measuring returns a character trivial on — an element of the dual — and polynomially many such characters, dualized, reconstruct .
A function that is constant on the cosets of a hidden subgroup encodes the subgroup's symmetry. Quantum mechanically you can produce, with one query, a uniform superposition over a single random coset — a coset state. For abelian the Fourier transform diagonalizes coset states, so measuring in the Fourier basis returns a character with for every , i.e. an element of the dual subgroup . Polynomially many such characters generate , and the duality recovers . The whole speedup is the QFT turning translational coset symmetry into easily measured orthogonality.
Where this lives today
The abelian HSP is not a museum piece — it is the reason post-quantum cryptography exists as a field. Shor's factoring and discrete-logarithm algorithms, both abelian HSP instances, break RSA, Diffie–Hellman, and elliptic-curve cryptography once a fault-tolerant quantum computer runs them, which is exactly why NIST has standardized lattice-based replacements. And here the nonabelian HSP re-enters through the back door: Regev showed that an efficient dihedral HSP algorithm would solve the worst-case unique Shortest Vector Problem, the very hardness assumption those new lattice schemes rest on. So the open status of dihedral HSP is a live security question, and Kuperberg's subexponential sieve — steadily refined for over a decade — sets the current benchmark that lattice parameters are chosen to stay ahead of. The symmetric-group case drives the other frontier: HSP over would place Graph Isomorphism in quantum polynomial time, a target that motivated a wave of "pretty good measurement" and multi-register sampling results before Babai's 2015 classical quasipolynomial algorithm reframed the whole question. Meanwhile small abelian instances run routinely on ion-trap, superconducting, and photonic hardware as compact demonstrations of coset-state preparation and Fourier sampling — the same skeleton, scaled down, that a cryptographically relevant Shor run will one day scale up.
The physical picture
Picture as a coloring of the group. Every element of a coset is painted the same color, and different cosets get different colors — so the hidden subgroup is the shape of one color class, translated to sit over every element. Classically you only ever see the color at points you query, and you learn nothing about the shape until you blunder into two elements sharing a color; finding such a collision is the whole difficulty. Quantum mechanically you do something no classical machine can: you prepare an even superposition over an entire color class at once, with a single oracle call, and then read its symmetry off in one shot.
A coset state is nothing but a translate of by the random offset . Translations are exactly what the Fourier transform diagonalizes — the convolution theorem — so in the Fourier basis the unknown becomes a harmless global phase and the surviving magnitude pattern picks out the dual subgroup , the frequencies on which is silent. That is the entire abelian mechanism: the QFT converts "constant under shifts by " into "supported on ", and the random coset never has to be identified. The map below is the punchline of the whole subject — where this clean story holds, and where it collapses.
The abelian-versus-nonabelian divide is the divide between phases and matrices. For abelian every irreducible representation is one-dimensional — a character — so a Fourier measurement returns a clean group element of , one linear constraint on . For nonabelian the irreps have dimension greater than one, the Fourier transform of a coset state is a block-diagonal matrix, and reading only the block label throws away the intra-block information needed to separate hidden subgroups. Recovering then becomes solving a linear system whose constraints you can no longer cleanly measure — which is why "find , then dualize" works beautifully for Simon and Shor and stalls completely for the dihedral and symmetric groups.
The core equations
The whole problem lives in the promise on . It is a structural guarantee — not a value you can read at any single point, but a symmetry relating every colliding pair of inputs to the same hidden subgroup.
where: — the ambient group, finite or finitely generated; — the hidden subgroup to be found; — the left coset of containing ; — an arbitrary set of labels. Reading: is constant on each coset and injective across cosets, so its level sets are the cosets of . One oracle call, followed by discarding the answer register, leaves the input register in a uniform superposition over a single randomly chosen coset. This coset state is the object every downstream step manipulates.
where: — a coset representative, drawn uniformly at random by the algorithm and never learned directly; — the order of the hidden subgroup. Reading: the state is a translate of by the random offset , so all cosets look alike up to a shift. For abelian the irreducible representations are one-dimensional characters — phase functions indexed by elements of the dual group , which is isomorphic to itself. These characters are the matrix entries of the Fourier transform.
where: — the character labeled by ; — the pairing on , e.g. for ; — the dual group. Reading: each character is a homomorphism, , which is the single algebraic fact the algorithm exploits. The Quantum Fourier Transform over is the unitary whose rows are these characters. For the Boolean cube it is just a wall of Hadamards; over it is the familiar discrete Fourier transform.
where: — the Fourier transform on the group algebra ; over it equals . Reading: "apply the QFT" and "Fourier-sample the hidden subgroup" are the same instruction. The dual, or orthogonal, subgroup collects exactly the characters that are blind to — trivial on every element of it. Its size is fixed by a clean counting identity.
where: — the annihilator of inside . Reading: characters split into those constant on (which survive) and those that oscillate across it (which cancel); the former are precisely . Applying the QFT to a coset state and collecting terms leaves amplitude only on , each carrying an unobservable phase from the random offset. This is the line the entire abelian theory turns on.
where: the sum runs only over ; the offset enters solely through the phase . Reading: the random coset has been converted into a random dual element, with the offset demoted to invisible phase. Squaring the amplitudes gives the sampling law: a measurement returns a uniformly random member of and nothing else. Every run donates one such element — one linear constraint on .
where: — the sampled dual element; the phase vanishes from the probability because . Reading: the distribution depends on alone, never on the random offset, so the offset can never leak — and after samples is generated and is recovered by linear algebra.
The goal is to follow one abelian run from a coset state through the Fourier transform and prove that measurement yields a uniformly random element of the dual subgroup , with the random coset representative surviving only as an unobservable phase. This mechanism — a single character-orthogonality sum collapsing the support onto — is the reason every abelian HSP instance is efficient, so we track amplitudes explicitly rather than gesture at "interference", and we finish by inverting the duality to get itself.
Step 1. Start from the coset state and apply , expanding each into the Fourier basis to reach . Why: the Fourier transform is the natural basis for translations, so writing the coset in it is what will expose the hidden periodicity as a support condition.
Step 2. Use that characters are homomorphisms, , and pull the offset phase — which does not depend on — outside the inner sum, leaving . Why: separating from isolates all dependence on the random coset into a single scalar phase, which is what makes the offset ultimately invisible.
Step 3. Evaluate the inner character sum by orthogonality: if and otherwise, because restricted to is either the trivial character or a nontrivial one summing to zero. Substituting gives , equation (6). Why: this is the decisive step — the coset symmetry cancels every frequency except those trivial on , so the support is exactly the dual subgroup.
Step 4. Take the modulus squared: each surviving has probability , independent of , so measurement returns a uniformly random . Repeat to collect ; once they generate , solve the linear system whose solution set is . Why: the flat distribution means samples suffice to generate , and the double-dual identity converts measured characters back into a generating set for the hidden subgroup. *Verified: for , gives of size , and independent samples fix — exactly Simon's algorithm; the counting was checked for , , giving .*
Go deeper · Derivation B · 1 minOrder finding as the hidden subgroup problem over the integers
Go deeper · Derivation C · 1 minWhy nonabelian Fourier sampling can fail
The goal is to expose the obstruction that keeps the dihedral and symmetric hidden subgroup problems open: for nonabelian the Fourier transform of a coset state is a block-diagonal matrix over irreducible representations, and measuring only the block label — weak Fourier sampling — yields a distribution that cannot distinguish conjugate hidden subgroups. We decompose the averaged coset state, compute the weak-sampling distribution, and show it is identical for conjugate , so no post-processing of that data alone can succeed.
Step 1. For nonabelian the irreps generically have dimension , so characters no longer label measurement outcomes uniquely; the averaged coset state becomes with . Why: with higher-dimensional irreps the Fourier transform maps a coset state to a matrix, not a phase, so the clean single-element outcome of the abelian case is gone.
Step 2. Weak Fourier sampling measures only the irrep name , giving , which depends only on the multiplicity of the trivial -subrepresentation inside . Why: discarding the intra-block register keeps only how many -invariant directions each irrep contains, a coarse statistic.
Step 3. Conjugate subgroups have and related by a change of basis, so and hence for every . Why: the weak-sampling distribution is a conjugation invariant, so it literally cannot tell a hidden reflection in from any of its conjugates.
Step 4. Therefore weak sampling is information-theoretically insufficient for and ; one must perform strong sampling within each -dimensional block, and no general efficient way to invert that data is known — Kuperberg's sieve reaches only for the dihedral case. Why: the missing information sits inside the irrep blocks, and extracting from it efficiently is exactly the open problem tied to lattices and graph isomorphism. *Verified: consistent with Hallgren–Russell–Ta-Shma and Grigni et al. that weak Fourier sampling cannot solve or HSP, and with Kuperberg's subexponential dihedral sieve.*
Limiting cases
Specializing and recovers the textbook quantum algorithms and marks where the theory ends:
| Case | Result | Meaning |
|---|---|---|
| Simon's problem: Fourier sampling returns with ; independent samples fix . | ||
| Order finding: the hidden period gives Shor's factoring via the QFT and continued fractions. | ||
| Discrete logarithm is read off the slope of the hidden line . | ||
| (dihedral) | (a reflection) | Nonabelian HSP equivalent (Regev) to worst-case lattice problems; only subexponential algorithms known (Kuperberg). |
| (symmetric) | or order two | HSP over solves Graph Isomorphism; weak Fourier sampling provably fails, no efficient algorithm known. |
Worked examples
1 · Abelian HSP over ℤ₈, fully worked
Take with hidden subgroup of order two. Suppose an oracle colors the group by coset. Walk through coset-state preparation, Fourier sampling, and the duality that recovers .
Step 1. List the cosets. Adding to each element pairs with , giving the four cosets — count , so takes exactly 4 distinct values. One query into an ancilla, then measuring the ancilla, collapses the input register onto one of these, say , a coset state with random offset .
Step 2. Identify the dual subgroup. A character is trivial on when , i.e. when is even. So , of size , matching equation (5).
Step 3. Fourier-sample. Applying to and squaring amplitudes gives probability on each of and exactly zero on the odd elements — the offset contributes only the phase , which cancels in the probability. Each run therefore returns one uniformly random even number.
Step 4. Recover . Collect samples until they generate ; for instance and generate all of under addition mod 8. Now solve for all sampled , i.e. and : both force . The double dual is exactly the hidden subgroup, recovered from two informative measurements plus a line of modular arithmetic. H = {0, 4}, obtained from H⊥ = {0, 2, 4, 6} by dualizing.
2 · Order finding as HSP: factoring 15, fully worked
Use the HSP-over- picture to factor with base . Find the hidden subgroup, the period, and the factors.
Step 1. The oracle is . Tabulate: . The values repeat with period 4, so and the hidden subgroup is .
Step 2. Read off the period. The smallest positive with is , so the multiplicative order is ; the quantum part (phase estimation on , then continued fractions on a measured ) delivers exactly this . Here is even — the good case.
Step 3. Split . Compute , and check , so the case is nondegenerate. Then and .
Step 4. Conclude. The nontrivial factors are and , and indeed . A single abelian HSP instance — hidden subgroup inside — has factored the modulus. Factoring 15 with a = 7 reduces to finding H = 4ℤ, giving r = 4 and the factors 3 and 5.
Physics of the portrait
The Hidden Subgroup Problem is a piece of theoretical computer science, but it belongs in a physics-flavored quantum course because it is where the mechanism of quantum advantage becomes visible: symmetry, encoded by a group, read out by a Fourier transform. The person who first saw that the disparate 1994 breakthroughs were one problem, and who supplied the tool that solves the whole abelian family, was Alexei Kitaev.
Origins · 1 minAlexei Kitaev and how this was discovered
Alexei Kitaev is one of the rare physicists who reshaped both quantum computing and condensed-matter theory. In 1995, months after Shor and Simon, his paper Quantum Measurements and the Abelian Stabilizer Problem introduced quantum phase estimation — the routine for reading an eigenphase of a unitary to many bits — and used it to solve the abelian stabilizer problem, which is the hidden subgroup problem for finite abelian groups stated in the language of group actions and eigenvalues. This unified Shor's factoring and discrete logarithm and Simon's period finding as a single algorithm: prepare a coset state, apply the Fourier transform over the group, sample the dual, and dualize back. Phase estimation is now the backbone of Shor's algorithm, quantum chemistry simulation, and the amplitude-estimation family, and it is how most textbooks actually derive order finding. Kitaev's reach did not stop there — he went on to invent the toric code and the theory of topological quantum computation with anyons, the Kitaev chain and its Majorana modes, and later the Sachdev–Ye–Kitaev model connecting quantum chaos to black-hole physics. But within the story of this article his decisive contribution is the recognition that a symmetry hidden in a function's level sets can be estimated as a phase, turning the scattered quantum speedups of 1994 into instances of one clean problem.
Going further
Texts. Nielsen & Chuang, Quantum Computation and Quantum Information (10th anniversary ed.), §5.4 (quantum Fourier transform and applications; hidden subgroup discussion) and §5.3 (order finding) · Preskill, Lecture Notes for Physics 219, Chapter 6 (quantum algorithms; period finding and HSP) · Watrous, The Theory of Quantum Information (Fourier analysis over groups) · Kitaev, Shen, Vyalyi, Classical and Quantum Computation (the abelian stabilizer / hidden subgroup problem) · Childs & van Dam, Quantum algorithms for algebraic problems, Rev. Mod. Phys. 82, 1 (2010) · A. Kitaev, Quantum Measurements and the Abelian Stabilizer Problem (1995) · Ettinger, Høyer, Knill, The quantum query complexity of the hidden subgroup problem is polynomial (2004) · Regev, Quantum computation and lattice problems (2004) · Kuperberg, A subexponential-time quantum algorithm for the dihedral hidden subgroup problem (2005).
Provenance. The coset-state-to-dual mechanism (equations 2–7) is recomputable from and the character-orthogonality sum ; cross-check against Nielsen & Chuang §5.4 and Watrous's Fourier chapter. The duality and follow from finite-abelian-group theory and were checked numerically for , giving . Order-finding sizing (, success per peak) is Nielsen & Chuang §5.3.1; the factoring example (, factors 3 and 5) was verified directly. The nonabelian weak-sampling obstruction follows Hallgren–Russell–Ta-Shma and Grigni et al.; the dihedral–lattice reduction is Regev (2004) and the subexponential sieve is Kuperberg (2005). No nonstandard numerical claims are made.
Prerequisites. Quantum Fourier Transform · Simon's Algorithm · Quantum Parallelism and the Oracle Model · Quantum Phase Estimation. Leads to. Shor's Factoring Algorithm · Quantum Discrete Logarithm Algorithm · Order Finding and Period Finding · Bernstein–Vazirani Algorithm.
Ask the tutor: Ask me to run the ℤ₈ hidden-subgroup example end to end — coset state, Fourier sampling of H⊥, and the dualization back to H — or to show exactly how the abelian recipe becomes Shor's order finding.
What exactly is a coset state, and why is it the right object?
A coset state is a uniform superposition over one left coset of the hidden subgroup, produced by evaluating into an ancilla and then discarding the ancilla — which projects the input register onto whichever coset shares the measured function value. It is the right object because it carries the hidden subgroup's symmetry while hiding the random coset representative : shifting every label by an element of leaves the state unchanged. That translational invariance is precisely what the Fourier transform is built to detect, so the coset state is the bridge between " hides " and "measurement reveals ".
Why does the random coset representative g never leak?
Because enters the post-Fourier state only through the phase factor multiplying each amplitude, and phases of modulus one vanish when you compute a probability. The measurement probability of outcome is , completely independent of . So although each run uses a fresh random offset, the outcome distribution depends only on the dual subgroup . This is a feature, not a bug: you do not want to learn — you want — and the algorithm automatically discards the irrelevant offset while keeping the relevant symmetry.
How is the Hidden Subgroup Problem related to Shor's algorithm?
Shor's algorithm is the HSP with and , whose hidden subgroup is for the multiplicative order of . The general abelian recipe — coset state, Fourier transform over the group, sample the dual, post-process — specializes to Shor's circuit with the QFT over playing the role of the group Fourier transform and continued fractions replacing the linear algebra used in the finite case. Once you have , the classical reduction turns period finding into factoring. So Shor is not a separate trick; it is the single most consequential instance of one general template.
What makes the nonabelian case so much harder than the abelian one?
For abelian groups every irreducible representation is one-dimensional — a character — so a Fourier measurement returns a single group element of , a clean linear constraint you can accumulate and solve. For nonabelian groups the irreps have dimension greater than one, and the Fourier transform of a coset state is a block-diagonal matrix. Measuring only the block label (weak Fourier sampling) provably cannot distinguish conjugate hidden subgroups, while measuring inside the blocks (strong sampling) keeps the needed information but leaves you with no general efficient way to extract . The information can even be there in polynomially many copies, yet require an exponential-time measurement to use — which is the crux of why dihedral and symmetric HSP remain open.
If the query complexity is polynomial, why isn't the problem solved?
Ettinger, Høyer, and Knill proved that for every finite group, polynomially many coset-state copies contain enough information, in principle, to determine . But "the information is present" and "you can extract it efficiently" are different statements. The optimal measurement that would read off those copies may itself take exponential time to implement, and the subsequent classical post-processing may be intractable. Efficiency demands both few queries and a polynomial-time procedure to identify from the measurement results, and it is the second requirement that fails for groups like and . Polynomial query complexity is a lower bound on hope, not a proof of an algorithm.
Why does the Hidden Subgroup Problem matter for cryptography?
Two ways, pointing in opposite directions. The abelian case is a threat: Shor's factoring and discrete-logarithm algorithms are abelian HSP instances, and they break RSA, Diffie–Hellman, and elliptic-curve schemes on a fault-tolerant quantum computer. The nonabelian case is a safeguard under suspicion: Regev showed that an efficient dihedral HSP algorithm would solve worst-case lattice problems, which are exactly the hardness assumptions underpinning most post-quantum cryptography. So the boundary between the solved abelian world and the open nonabelian world is also the boundary between "already broken" and "believed safe", and Kuperberg's subexponential dihedral sieve is the benchmark that lattice parameter choices must stay ahead of.