Holevo Bound
Alice draws a classical symbol with probability , encodes it into a quantum state , and hands the system to Bob. Bob measures — a POVM — reads an outcome , and tries to recover . How much of Alice's message can survive this quantum bottleneck? The figure of merit is the classical mutual information , and the best any measurement can do is the accessible information . The Holevo bound answers with a single, decisive inequality: whatever the measurement, , where is a quantity built from the ensemble alone and blind to how Bob measures. The number — the Holevo information — is not an ad hoc bound but a mutual information in disguise. Package the ensemble as a classical–quantum state ; then , the quantum mutual information between the label and the register. Bob's measurement is a quantum channel acting on alone, and the data-processing inequality forbids a channel from raising mutual information. The Holevo bound is that one line: . The consequence is stark. A -dimensional quantum system stores at most classical bits, exactly as a classical -level system does, because . Non-orthogonal alphabets, which seem to promise a denser packing of letters into Hilbert space, are punished twice: overlap lowers below , and measurement disturbance lowers below . Holevo's 1973 inequality is the impossibility half of quantum Shannon theory.
- For an ensemble the classical information any measurement extracts is capped by the Holevo quantity , with the average state.
- is exactly the quantum mutual information of the classical–quantum encoding, so the bound is a one-line corollary of the data-processing inequality.
- Because , no more than classical bits can be read from one -dimensional system: a qubit carries at most one bit.
- The bound is generally loose on a single copy — for non-commuting the accessible information is strictly below ; equality holds iff the states all commute.
- is the converse half of the Holevo–Schumacher–Westmoreland theorem: maximized over inputs it equals the product-state classical capacity of a quantum channel, approached by collective measurements over many copies.
- Key idea: A measurement is a CPTP map; data processing for quantum mutual information turns the bound into an immediate corollary, and is the quantum mutual information of the classical–quantum encoding.
A measurement is a CPTP map; data processing for quantum mutual information then turns the bound into an immediate corollary. The Holevo is the quantum mutual information of the classical–quantum encoding.
Where this lives today
The Holevo bound is no longer a curiosity but a working tool, and its deepest modern question is whether is the whole story. The additivity conjecture long held that the single-letter Holevo capacity in equation (7) equaled the true capacity — that entangling inputs across channel uses could not help. Shor showed in 2004 that additivity of Holevo capacity, of minimum output entropy, and of entanglement of formation were all equivalent; then in 2009 Hastings constructed a random channel violating additivity, proving that entangled inputs can raise the classical capacity and that the true capacity needs the regularized limit . The single-letter remains the achievable product-state rate every experiment reports, but its ultimate optimality is now known to fail in general. On the applied side, is the security ledger of quantum key distribution: Eve's information about a sifted key is bounded by the Holevo quantity of her side-information ensemble, and the Devetak–Winter secret-key rate subtracts exactly that bound from Alice and Bob's mutual information, yielding provable rates for BB84 and continuous-variable protocols now running over fibre and satellite links. The bound also underwrites quantum random-access codes: because a qubit yields at most one accessible bit, an -into-one random-access code with perfect recovery is impossible for , and laboratory and codes report retrieval probabilities in precise agreement with the Holevo ceiling.
The physical picture
Picture Alice's label tethered to a quantum register by a fixed amount of correlation, the quantum mutual information . Bob cannot touch ; he can only process , and processing a system blurs correlations, never sharpens them. So whatever pointer his apparatus produces, the correlation it retains cannot exceed the that was there to begin with. Holevo's inequality is conservation of information under processing, made precise. The first figure draws this cascade and stamps the relation onto it: correlation flows –– and can only shrink.
The penalty for non-orthogonality is geometric. When the have orthogonal supports they are perfectly distinguishable, climbs to , and a single projective measurement recovers everything. As the states crowd together their overlap makes them ambiguous to any apparatus: falls, and the accessible information falls further still, because measuring a non-commuting alphabet disturbs it. The second figure quantifies this for the cleanest case — two equiprobable pure qubits — showing the bound and the achievable pull apart as overlap grows.
A one-line slogan carries the moral: dimensions, bits. A single qubit, however cleverly loaded, yields at most one classical bit per use. Genuine quantum advantage in communication comes from entanglement — superdense coding — or from coding over many channel uses, never from over-packing an unentangled single system.
The core equations
The Holevo information is the gap between the entropy of the average state and the average of the entropies. It measures how much the ensemble's mixing hides — how much order is lost when the labels are forgotten and only remains.
where: — Holevo quantity (bits when uses ); — prior of letter ; — density operator for ; — ensemble-average state; — von Neumann entropy . Reading: is large when the letters spread across many dimensions while each letter stays sharp. The bound itself says that this ensemble quantity caps every measurement outcome. The right-hand side has no reference to the POVM at all — it is fixed before Bob chooses his apparatus.
where: — classical mutual information between label and outcome ; the measurement , obeying and , enters only through . Reading: no choice of beats — the ceiling is fixed by what was sent, not how it is read. The reason the bound is true, rather than merely plausible, is the identity that is a mutual information. Encode the ensemble as a classical–quantum state and its quantum mutual information equals exactly.
where: — quantum mutual information of the cq-state; — orthonormal classical flags on register . Reading: inherits every property of a mutual information — non-negativity and monotonicity under channels — which makes the bound fall out for free. An equivalent form writes as the average quantum relative entropy of each letter from the mean, exposing it as an average distinguishability.
where: — quantum relative entropy, zero iff . Reading: is the average distance of the letters from the mean; non-negativity of gives , with equality iff every . Two chains of inequalities bracket what can be and pin where the bound is tight. The dimensional ceiling is the headline; the commutation condition is the fine print.
where: — best single-copy accessible information; — Hilbert-space dimension of the letter. Reading: the staircase caps classical storage at bits per system, and each step can be strict; the gap is the price of non-orthogonality.
where: — commutator; mutual commutation means the letters share one eigenbasis, i.e. a classical ensemble in disguise. Reading: the single-copy bound is achievable exactly when quantumness is absent; otherwise is only an asymptotic rate. That asymptotic meaning is the Holevo–Schumacher–Westmoreland capacity: maximize over input ensembles of channel outputs and you get the achievable classical rate.
where: — a quantum channel (CPTP map); — its product-state (one-shot) classical capacity. Reading: inequality (2) is the converse and random coding with collective decoding is the achievability, making the quantum analogue of Shannon's capacity.
The engine of the entire subject is a single identity: the Holevo quantity of an ensemble is nothing other than the quantum mutual information of its classical–quantum encoding, . Establishing this converts an inequality about measurements into a statement about a fixed bipartite state, after which the data-processing inequality does all the remaining work. We compute the three entropies of in turn and assemble the mutual information, watching the classical terms cancel.
Step 1. Trace out to get the marginal on the label register: , a diagonal state whose von Neumann entropy is the Shannon entropy . Why: the are orthonormal, so the register is effectively classical and its quantum entropy collapses to the classical entropy of the priors.
Step 2. Trace out to get the marginal on the quantum register: , so . Why: forgetting the label mixes the letters into their weighted average, which is exactly the ensemble-average state that appears in the definition of .
Step 3. Compute the joint entropy. Because is block-diagonal across the orthogonal flags , its spectrum is the union of the spectra of the blocks , and the entropy splits as . Why: a block-diagonal state with known block weights has entropy equal to the classical entropy of the weights plus the weighted entropies within each block — the quantum version of the grouping axiom for entropy.
Step 4. Assemble the mutual information: . The two terms cancel, leaving . Why: the label entropy enters both the marginal and the joint term identically, so it drops out, and what remains is precisely the Holevo quantity.
Step 5. Read off the payoff: automatically, since a quantum mutual information is non-negative (subadditivity ), reproducing the concavity bound . Why: the identity does not merely rename — it hands us non-negativity and, next, monotonicity for free, which are the two facts the bound needs.
Go deeper · Derivation B · 1 minThe Holevo bound as data processing
With the identity in hand, the bound is a one-step consequence of the data-processing inequality — the monotonicity of quantum mutual information under a local channel, itself equivalent to strong subadditivity of the von Neumann entropy. The goal here is to make that step explicit: model Bob's measurement as a CPTP map on , apply it to the classical–quantum state, and show the surviving correlation is , which cannot exceed .
Step 1. Represent the measurement as a channel. A POVM defines the CPTP map , sending any input state to a classical pointer with distribution when fed . Why: measurement outcomes are the paradigm of classical data extracted from a quantum system, and Kraus operators show this map is completely positive and trace-preserving — a legitimate channel.
Step 2. Apply the channel to the half of , leaving untouched: . Both registers are now classical, so the quantum mutual information of equals the Shannon mutual information of the joint distribution . Why: a classical–classical state's quantum mutual information reduces to the ordinary Shannon quantity, so the abstract inequality below becomes a statement about the measurement's information yield.
Step 3. Invoke data processing. Acting with a channel on one subsystem cannot increase the quantum mutual information: . Why: this monotonicity is the operational content of strong subadditivity (Lieb–Ruskai); processing can destroy correlation with but never manufacture it, because a channel is a partial trace over an isometric dilation.
Step 4. Substitute the identity from the previous derivation, , to conclude for every POVM. Maximizing the left side over measurements gives . Why: the inequality holds pointwise in the measurement, so it survives the maximum that defines accessible information — the bound is universal over apparatus.
Go deeper · Derivation C · 1 minWhen the bound is tight
The single-copy bound is not always achievable, and characterizing when it is recovers exactly the classical world inside the quantum one. The claim: equality holds if and only if the states all mutually commute — share a common eigenbasis. The forward direction is a construction — a projective measurement in the shared eigenbasis makes the ensemble a classical channel attaining ; the converse traces the strict inequality to the impossibility of simultaneously diagonalizing non-commuting operators.
Step 1. Suppose all commute, so they share an eigenbasis with . Measure in that basis, , giving outcome statistics . Why: when a common eigenbasis exists, one measurement reads every letter without disturbance, so no quantum ambiguity remains.
Step 2. The resulting classical channel has mutual information equal to . Here and , so is precisely the classical mutual information of the joint distribution . Why: for a commuting ensemble the Holevo quantity is a classical mutual information in disguise, and the eigenbasis measurement realizes it exactly, so the bound saturates.
Step 3. Conversely, if some pair fails to commute, , no single basis diagonalizes all letters, and equality in the data-processing step fails: the measurement is not a sufficient statistic for . Hence strictly on one copy. Why: saturation of data processing demands that the channel be reversible on the relevant states (a recoverability condition), which non-commuting letters cannot satisfy — measuring one basis blurs the others.
Step 4. The gap is genuine and closes only asymptotically. For four BB84-style qubit states can reach one bit while stays well below it; only collective measurements over many copies drive the per-copy accessible information up to , which is the achievability half of HSW. Why: is an asymptotic rate, not a single-shot yield — the strict single-copy gap is the whole reason quantum Shannon theory needs block coding.
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Orthogonal pure states | so | Perfectly distinguishable letters; the bound saturates and via one projective measurement — fully classical. |
| Identical states | so | The average equals every letter, ; nothing about can be learned, and . |
| Two non-orthogonal pure qubits | , | Overlap pushes below one bit, and is strictly smaller still. |
| Maximal ensemble | For any -dimensional letter never exceeds bits — the hard ceiling on classical storage in a quantum system. |
Worked examples
1 · Two non-orthogonal pure states — the bound and the gap (fully worked)
Alice sends or , each with probability . Find , and compare it with the accessible information .
Step 1. The overlap is . The average state is , whose eigenvalues are and .
Step 2. Each letter is pure, so and . Evaluating the binary entropy, . This is the ceiling on any measurement's yield.
Step 3. The optimal single-copy measurement (a projective measurement in the basis symmetric to the two states) gives . The bound is loose by : overlapping states advertise bit of distinguishability, but a single measurement can cash in only bit.
Step 4. Sanity checks at the extremes. Orthogonal (): bit and bit — everything readable. Identical (): both vanish. The bound bit is real information, but only bit is single-shot accessible.
2 · A mixed-state ensemble — computing χ with an impure letter
Alice sends the pure state with probability and the maximally mixed state with probability . Find .
Step 1. The average state is , diagonal with eigenvalues and , so .
Step 2. The average of the letter entropies is , since a pure state has zero entropy and the maximally mixed qubit has entropy .
Step 3. Therefore . The second letter's own entropy is subtracted off — mixedness in the letters costs Holevo information, which is why noisy channels shrink capacity. bit, well under the bit ceiling.
Physics of the portrait
The Holevo bound is where classical information theory and quantum mechanics were first forced to reconcile: Shannon's bits meet Hilbert space, and the meeting has a hard limit.
Origins · 1 minAlexander Holevo and how this was discovered
Alexander Semenovich Holevo, born in 1943, is the Russian mathematician who founded the quantitative theory of information transmission over quantum channels. In 1973, at the Steklov Mathematical Institute in Moscow, he proved the inequality now bearing his name — establishing, against a then-common intuition that non-orthogonal states might pack unlimited data into a single system, that the accessible information is capped by . The result was decades ahead of the field it would anchor: only in the 1990s, when quantum information became a discipline, did its full weight land. Holevo went on to contribute the converse and, in 1998, part of the achievability of the Holevo–Schumacher–Westmoreland theorem, identifying maximized as the product-state classical capacity of a quantum channel — the exact analogue of Shannon's 1948 noisy-channel coding theorem. His monograph Probabilistic and Statistical Aspects of Quantum Theory built the rigorous foundations of quantum measurement and channel theory. The bound is his signature: a clean entropic inequality that turned "how much classical information fits in a quantum state" from intuition into a theorem.
Going further
Texts. Nielsen and Chuang, Quantum Computation and Quantum Information, section 12.1.1 (Holevo bound) · Holevo, "Bounds for the quantity of information transmitted by a quantum communication channel," Problemy Peredachi Informatsii 9, 3 (1973) · Wilde, Quantum Information Theory, 2nd ed., chapters 11–13 · Watrous, The Theory of Quantum Information, chapter 5 · Preskill, Lecture Notes for Physics 219, chapter 10 · Schumacher and Westmoreland, Phys. Rev. A 56, 131 (1997); Holevo, IEEE Trans. Inf. Theory 44, 269 (1998); Hastings, Nature Physics 5, 255 (2009). The key entropic identities to keep in mind: the block-diagonal split yields ; the relative-entropy form gives ; and the staircase holds in full generality. The two-pure-state anchor values at are bit and bit; the mixed-ensemble value is bit. Note: the correct single-copy Holevo quantity for two pure states is in the overlap ; the form with instead of gives the accessible information, not .
Prerequisites. Von Neumann Entropy · Quantum Joint, Conditional Entropy and Mutual Information · Data-Processing Inequality · Shannon Entropy and Classical Information Measures. Leads to. Holevo–Schumacher–Westmoreland Theorem · Quantum Channels and Completely Positive Trace-Preserving Maps · Schumacher Quantum Data Compression · Strong Subadditivity of Quantum Entropy.
Ask the tutor: Want to see why data processing is equivalent to strong subadditivity, or work through the accessible information of a specific ensemble by hand?
Is the Holevo bound the same as the channel capacity?
Not quite — it is one half of it. The Holevo bound (2) is the converse: no measurement extracts more than from a single copy. The Holevo–Schumacher–Westmoreland capacity (7) adds the achievability: over many channel uses, random coding with a collective decoding measurement attains a rate approaching maximized over inputs. The bound tells you the ceiling; the capacity theorem tells you the ceiling is reachable asymptotically. On a single copy the bound is usually loose, which is exactly why the capacity needs a many-copy, block-coding argument.
Why is χ not simply the accessible information?
Because measuring a non-commuting alphabet disturbs it, and no single apparatus is simultaneously optimal for letters that do not share an eigenbasis. counts the correlation in the classical–quantum state, ; the accessible information counts what a real measurement retrieves, . Data processing forces , but the inequality is strict whenever the fail to commute — as the worked example shows, bit while bit. Only over many copies, with collective measurements, does the per-copy accessible information climb to .
How can χ depend on the ensemble if the average state ρ is fixed?
This is a genuine subtlety. The same density matrix can be written as in infinitely many ways, and different decompositions give different . The maximally mixed qubit is an equal mix of with bit, or of infinitely many overlapping states with smaller . The Holevo quantity is a property of the preparation — the labelled ensemble — not of the state alone, which is why references both the letters and their average.
Does the bound mean a qubit "holds" only one bit of information?
Only one classical bit can be reliably read out, which differs from what the qubit contains. A qubit's state is a point on the Bloch sphere — continuous parameters, so in a loose sense infinite information. But you cannot retrieve them as classical data: any single measurement collapses the state and returns at most bit by the Holevo bound. The extra structure powers quantum algorithms and entanglement-based protocols, but as a channel for classical letters a qubit is exactly as capacious as a classical bit.
What role does strong subadditivity play here?
It is the deep engine underneath. The Holevo bound rests on the data-processing inequality — that a local channel cannot increase quantum mutual information — and that monotonicity is mathematically equivalent to strong subadditivity (SSA) of the von Neumann entropy, , proved by Lieb and Ruskai in 1973. So every use of the Holevo bound is, at bottom, an application of SSA — and any proof of SSA immediately re-proves Holevo.
How does the Holevo bound secure quantum key distribution?
In QKD, an eavesdropper Eve holds a quantum system correlated with the raw key. Her total knowledge is capped by the Holevo quantity of her side-information ensemble — she can never learn more, even with a quantum memory and delayed collective attacks. The Devetak–Winter theorem gives a provable secret-key rate : Alice and Bob keep the mutual information they share, minus the Holevo bound on what Eve could know. Because is estimated from the observed error rate, the bound converts measured noise directly into a guaranteed number of secure bits — the heart of QKD security proofs.