Density Matrix Formalism
Quantum mechanics hands you a state vector and statistical mechanics hands you an ensemble of possibilities weighted by probabilities; the density matrix fuses the two into one object. The state vector is the language of perfect knowledge — every amplitude and phase specified, a pure state. But real atomic ensembles almost never live there. A thermal vapour is a Boltzmann-weighted mixture of energy eigenstates; an atom that has just spontaneously emitted is entangled with a photon it can no longer see, and alone occupies a mixed state; collisions scramble phases in ways no wavefunction tracks. Von Neumann built the density operator precisely to carry both kinds of uncertainty at once — the quantum uncertainty inside a single , and the classical uncertainty of not knowing which you have. Written out, with and , its matrix elements split into two distinct jobs. The diagonal entries are the populations — probabilities of finding the atom in level . The off-diagonal entries are the coherences, whose size and phase measure how well-defined the superposition between and is. Coherences are the source of the oscillating atomic dipole that drives absorption and stimulated emission; erase them and the atom radiates only through population differences, and the Einstein rate-equation picture drops out. Dynamics obey the Liouville–von Neumann equation , and once relaxation is added this becomes the optical Bloch equations — the master language wherever coherence, statistical mixing, and dissipation coexist: laser spectroscopy, coherent control, quantum optics, and quantum information.
- The density operator generalizes the state vector to statistical mixtures, subsystems of entangled states, and ensembles no wavefunction can capture.
- Its diagonal elements are populations (probabilities); its off-diagonal elements are coherences, encoding the phase relations behind interference, Rabi flopping, and dipole radiation.
- The equation of motion is ; adding relaxation yields the optical Bloch equations governing absorption, saturation, and fluorescence.
- Purity diagnoses the state — pure, toward maximally mixed — and every observable follows from a single trace, .
- A two-level state maps onto the Bloch sphere: populations set the polar angle, coherences the azimuth, and relaxation drags the tip inward toward equilibrium.
- Key idea: the density operator packages populations (diagonal, probabilities) and coherences (off-diagonal, phase relations) into one object whose Hermiticity, unit trace, and positivity guarantee sensible probabilities, and whose evolution plus relaxation reproduces all of quantum optics — from Rabi flopping to the Einstein rate equations.
Where this lives today
The density matrix is the daily language of atomic, molecular, and optical physics. Every magneto-optical trap and laser-cooling stage is designed by solving the optical Bloch equations: the steady-state sets the scattering force, its ceiling caps the deceleration, and the coherences set the sub-Doppler features that carried cooling below the Doppler limit. In atomic clocks and quantum computers the same tracks the qubit, and the coherence time is the number the field fights to extend — every dynamical-decoupling sequence and magnetic shield is an attempt to keep the off-diagonal elements alive longer. Saturated-absorption spectroscopy reads the steady-state coherence directly as a Lorentzian susceptibility, and the reduced density matrix — a subsystem after its environment is traced away — is the working model of decoherence that sets error rates for quantum information.
The physical picture
Think of as a small square ledger. Down the diagonal it records how much of the atom sits in each level — ordinary probabilities that add to one. Off the diagonal it records how tightly the phases between levels are locked: a perfectly phased superposition fills those cells to maximum magnitude, a randomized ensemble leaves them at zero. Both the classical statistician's question ("which level?") and the interferometer's question ("what phase relation?") are answered by reading different cells of the same matrix — which is what makes irreducible.
Geometrically, a two-level system maps onto the Bloch sphere. A pure state is a unit arrow touching the surface: populations fix its polar angle, coherences fix its azimuth. Statistical mixing shortens the arrow so it retreats inside the ball, and a maximally mixed state sits at the centre with no direction at all. Relaxation is friction: longitudinal decay pulls the polar component toward the ground state as atoms emit, transverse decay collapses the azimuthal component as coherences dephase. The purity is just how far the arrow reaches — the single number telling pure () from mixed.
Why introduce when already works for isolated systems? Because open systems and subsystems generically have no wavefunction. Trace out the photon after spontaneous emission and the atom alone is genuinely mixed — no in Hilbert space reproduces its statistics. Here the density matrix is not a convenience but the only correct description. And every observable still emerges from one operation, , a trace that performs the quantum expectation inside each pure component and the classical average across components in a single stroke.
The core equations
The starting point is the definition. Instead of a single ket, the state is a probability-weighted sum of projectors onto the pure states that might have been prepared; the kets need not be orthogonal, which lets the same be decomposed many ways.
where: — density operator; — classical probability of having prepared ; — normalized pure states (not necessarily orthogonal). A pure state is the special case where one ; any spread of the over distinct states is genuine statistical mixing. Three properties make a legitimate description of probabilities; a matrix failing any of them is not a physical state. It is Hermitian (real eigenvalues), unit-trace (total probability conserved), and positive semidefinite (no measurement returns a negative probability).
where: — Hermiticity; — probability conserved; — positivity. Positivity is the sharpest constraint: it caps every coherence at , so phase locking can never exceed what the populations permit. Every measurable quantity is extracted the same way — a single trace of the operator against — replacing both the quantum expectation of a pure state and the classical average over the ensemble at once.
where: — any observable; in the basis ; . Because coherences multiply off-diagonal operator elements, an off-diagonal observable like the dipole moment reads out precisely the coherences, not the populations. The state's evolution is fixed by the Hamiltonian through a commutator — the density-operator sibling of the Schrödinger equation. Note the ordering , opposite in sign to the Heisenberg equation for operators.
where: — Hamiltonian; . Coherent evolution never changes the eigenvalues of , so purity is conserved: a closed system that starts pure stays pure. Mixedness enters only through relaxation or through tracing out a partner. The single number separating pure from mixed is the purity. It equals one exactly when is a projector onto one state and falls as probability spreads across eigenstates, bottoming out at in dimensions.
where: — eigenvalues of (). Purity is basis-independent, so it is a genuine physical property of the state and the cleanest experimental handle on decoherence. For a two-level system the whole state collapses onto a single three-vector. Writing with the identity and the Pauli matrices exposes the geometry: the Bloch vector carries everything, its length is the purity, and its components split into a population part and a coherence part.
where: — Bloch vector; — Pauli matrices; — inversion; — coherence. pure (surface), mixed (interior), maximally mixed (centre). Finally, the operation that manufactures mixed states from pure ones: the partial trace. Summing over one half of an entangled pair leaves the other in a mixed state even though the pair as a whole is pure — the formal statement that a subsystem of an entangled state has no wavefunction of its own.
where: — partial trace over subsystem (e.g. the emitted photon); — reduced state of (the atom alone). Entanglement with an unobserved partner is a source of mixedness distinct from classical ignorance — and, for spontaneous emission, the physical one.
The goal is to earn equation (4) rather than assert it: to show that if every pure member of the ensemble obeys the Schrödinger equation, the density matrix built from them obeys , and to see where the commutator — with its sign opposite to Heisenberg's — comes from. This matters because the sign is a frequent error, and because the derivation shows that coherent evolution conserves purity, so mixedness can only arise from relaxation or from tracing out a partner.
Step 1. Write the Schrödinger equation for one ensemble member and its conjugate: and . The weights are fixed at and do not evolve. Why: the ket and bra pick up opposite signs of , and that opposition becomes the commutator.
Step 2. Differentiate by the product rule: . Why: only the states carry time dependence, so the derivative acts term by term and leaves the weights untouched.
Step 3. Substitute Step 1. The first bracket gives , the second ; summing, . Why: each bracketed sum is exactly , so the equation closes on itself — autonomous, needing no reference to individual .
Step 4. Contrast the Heisenberg equation , whose commutator is reversed: is a state built from kets, not a Heisenberg operator, so its generator sits on the left. Why: the sign is the difference between a coherence rotating the right way on the Bloch sphere and the wrong way.
Go deeper · Derivation B · 1 minWhy a mixed state has no wavefunction the reduced density matrix after emission
The aim is the most convincing reason the density matrix is indispensable: after an atom spontaneously emits, it is genuinely mixed, and no wavefunction reproduces its statistics, even though the atom plus photon together remain perfectly pure. This is not classical ignorance about which state was prepared; it is entanglement with a partner we chose not to look at. The calculation is short and exact, and it is the microscopic origin of decoherence, of why the diagonal Einstein picture is valid, and of the coherence-decay term .
Step 1. Start with the atom excited and the field in vacuum, . Emission couples this to "photon emitted, atom decayed," giving the entangled state , . Why: the atom's fate and the photon's presence are now perfectly correlated — the signature of entanglement.
Step 2. Form the joint operator , still pure: . Why: nothing irreversible has happened to the whole — the lost information is only about which part we keep.
Step 3. Trace over the field, . The cross terms carry , since zero- and one-photon states are orthogonal. Why: those cross terms are the atomic coherences — the trace kills them because the photon's which-path record is perfect.
Step 4. What survives is diagonal, , purity . For that is : a mixed state no can match. Why: had the field states been identical (, no entanglement), the coherence would survive and factor into a pure atomic state — so entanglement, not ignorance, mixed the atom.
Go deeper · Derivation C · 2 minThe optical Bloch equations and steady state saturation
The payoff: take a two-level atom driven by a near-resonant laser, add spontaneous emission and dephasing as relaxation, and read off the steady state. This is where the formalism becomes the working tool of laser spectroscopy — it yields the Lorentzian absorption line, the saturation of a strong transition, and, in the fast-dephasing limit, the Einstein rate equations exactly. Resonance fluorescence, saturated-absorption spectroscopy, and laser cooling all rest on the two coupled equations below.
Step 1. Split with dipole coupling , and define the Rabi frequency and detuning . Move to the rotating frame, make the rotating-wave approximation, and use the slow coherence . Why: measures how hard the field shakes the dipole and how far off resonance; the rotating frame removes the fast optical oscillation.
Step 2. Evaluate in the rotating frame; the commutator couples populations and coherences through : and . Why: driving does not change populations directly — it first builds a coherence, which then feeds the excited population, so coherence is the engine of absorption.
Step 3. Add relaxation: population decays at , coherence at ( = collisional dephasing). The optical Bloch equations follow: and . Why: for pure radiative decay the coherence dies at half the population rate because amplitude decays half as fast as probability; collisions add to without touching .
Step 4. Set : . Its absorptive part is a Lorentzian of full width in detuning — the natural line shape read off the coherence. Why: the atom responds like a damped driven oscillator, and the density matrix delivers that Lorentzian without leaving the two-level picture.
Step 5. Feed back to get with . As , : populations equalize and net absorption stops. Why: this ceiling makes fluorescence and laser cooling finite — an atom scatters at most photons per second however hard you drive it.
Step 6. Check the classical limit: for weak driving and fast dephasing (, large) eliminate the coherence adiabatically to leave — the Einstein rate equation, carried by and by . Why: this is the seam where coherent quantum optics rejoins the rate-equation picture, showing the Einstein coefficients as a limit of the density matrix, not a separate postulate.
Limiting cases
The formalism interpolates smoothly between familiar regimes as the coherences and the mixing are dialled:
| Case | Result | Meaning |
|---|---|---|
| Pure state | is a projector; all statistics come from one wavefunction — the ordinary Schrödinger limit. | |
| Maximally mixed | every basis state equally likely, all coherences zero, no preferred Bloch direction — the fully thermalized limit. | |
| Coherences damped () | Einstein rate equations | adiabatically eliminate ; only populations evolve, recovering the -coefficient absorption and -coefficient spontaneous rates. |
| Thermal equilibrium | diagonal in the energy basis, Boltzmann-weighted populations, exactly zero coherence — the canonical density matrix of statistical mechanics. | |
| Strong driving () | populations saturate, scattering rate ceils at . |
Worked examples
1 · The thermal excited-state population of the sodium D line (a confidence builder)
A sodium vapour at K sits in thermal equilibrium. The D transition is at nm. What fraction of atoms is in the excited state, and what does that say about the coherences?
Step 1. The transition frequency is Hz, so J eV — an optical energy of a couple of electron-volts.
Step 2. Compare the thermal energy J eV. The ratio — eighty-one thermal quanta.
Step 3. The Boltzmann-weighted excited fraction is . For all practical purposes , , purity — essentially the pure ground state.
Step 4. The lesson is off-diagonal. A thermal density matrix is diagonal in the energy basis: its coherences are exactly zero, so an undriven vapour carries no optical dipole and cannot emit coherently — to make it radiate you must drive it, building the coherence that equilibrium forbids. Hence the next example needs a laser.
2 · Saturating the sodium D₂ line with a resonant laser
The Na D₂ line has a natural linewidth MHz (radiative lifetime ns). Drive it exactly on resonance () with pure radiative damping () at Rabi frequency . Find the steady-state excited population and the photon scattering rate, and the maximum possible scattering rate.
Step 1. Convert: , so ns.
Step 2. On resonance ; with , .
Step 3. The excited population is — one atom in three excited at any instant.
Step 4. Each excited atom decays at , so , about 20 million per second.
Step 5. As the drive , and . However intense the laser, a two-level atom cannot scatter faster than photons per second — the ceiling that limits the force in laser cooling.
3 · Purity and the Bloch vector of a partially coherent state
An atom is described by populations , and a real coherence . Is this a valid state, and how mixed is it?
Step 1. Check positivity. The coherence is capped at . Since , the state is physical.
Step 2. Compute the purity directly, . Below one, so the state is mixed.
Step 3. Cross-check via the Bloch vector: , , giving . Then — the two routes agree. The state is genuinely mixed, , with a Bloch vector of length reaching partway to the surface.
Physics of the portrait
The density matrix is where quantum amplitudes and classical probabilities were first made to live in one equation — and the person who built that equation was a mathematician working out what a quantum measurement really is.
Origins · 1 minJohn von Neumann and how this was discovered
John von Neumann introduced the density operator in 1927, in the same run of papers that cast quantum mechanics into the rigorous language of Hilbert space. He wanted a single object to describe a system known only statistically — a beam of atoms with a spread of spins, a subsystem of a larger correlated whole — and found it in , with the rule turning any observable into a trace. He proved the equation of motion that bears his and Liouville's names, and defined the entropy measuring mixedness — zero for a pure state, maximal for the fully thermalized one. Lev Landau reached the density matrix independently that same year, studying how a subsystem loses its wavefunction — the very mechanism behind the reduced density matrix here. Von Neumann's 1932 Mathematische Grundlagen der Quantenmechanik systematized the whole apparatus, and it is still the framework in which decoherence, quantum information, and the optical Bloch equations are phrased. The formalism reduces to ordinary wavefunctions exactly when the state is pure, and takes over everywhere a wavefunction cannot go.
Going further
References. Foot, Atomic Physics (2005), Ch. 7 — density matrix and optical Bloch equations · Loudon, The Quantum Theory of Light (3rd ed., 2000), Ch. 2 and 6 — density operator and resonance fluorescence · Cohen-Tannoudji, Diu and Laloë, Quantum Mechanics, Vol. 1, Complement E_III — the density operator · Demtröder, Laser Spectroscopy, Vol. 1 — coherence and relaxation in spectroscopy · Sakurai and Napolitano, Modern Quantum Mechanics — statistical mixtures and the density operator · Blum, Density Matrix Theory and Applications (3rd ed., 2012).
Provenance. Definitions and properties of follow Cohen-Tannoudji Complement E_III and Sakurai; the Liouville–von Neumann derivation and the optical Bloch equations follow Foot Ch. 7 and Loudon Ch. 6. A verifier should reconfirm: the sign of against Heisenberg's ; the steady state with ; the relation for pure radiative decay; and the purity bound with equality iff pure. The worked numbers are standard: Na D at 589 nm gives and at 300 K; Na D₂ with MHz ( ns) gives ; the partial-coherence example has , .
Builds on: Electric Dipole Approximation · Transition Dipole Moment · Einstein A and B Coefficients. Leads to: Stimulated Emission · Spontaneous Emission · Lorentzian Line Shape · Radiative Lifetime and Natural Linewidth.
Ask the tutor: Ask me to walk you through building the optical Bloch equations for your own atom and reading its saturation and linewidth straight off the steady-state density matrix.
What is the difference between a pure state and a mixed state?
A pure state is one you know completely as a single wavefunction, so and ; a mixed state is a probabilistic ensemble of several wavefunctions, with more than one nonzero and . The crucial subtlety: a coherent superposition like is pure, not mixed — it is one definite wavefunction. Mixedness means genuine classical uncertainty about which wavefunction you have, or entanglement with something you traced away, and only mixedness lowers the purity below one.
Are the coherences the same as a superposition?
They are the fingerprint of one. In a coherent superposition the off-diagonal elements are nonzero and carry a definite phase; in a statistical mixture of the same two levels they are exactly zero even though the populations are identical. So a nonzero coherence is precisely what tells you a superposition, not a mixture, is present. Physically the coherence is the amplitude of the oscillating atomic dipole — what absorbs, emits stimulated radiation, and interferes. Kill the coherences and the atom still has populations but behaves like a classical probabilistic object with no wave character.
Why does the density matrix use a trace for every measurement?
Because the trace does two averages in one operation: inside each pure component it computes the quantum expectation , and across components it weights by the classical probabilities — exactly the two kinds of averaging a mixed state demands. Algebraically , which shows a second virtue: off-diagonal observables like the dipole moment pick out the coherences, while diagonal observables like energy pick out the populations. The trace is also basis-independent, so the prediction never depends on how you wrote the matrix.
How does the density matrix recover the Einstein rate equations?
Through the fast-dephasing limit of the optical Bloch equations. When is large, relaxes to its quasi-steady value almost instantly and can be eliminated adiabatically — set and substitute back. What remains are closed equations for populations alone, , with a stimulated rate (the coefficient) and a spontaneous rate (the coefficient). The Einstein picture is thus not a separate theory but the coherence-free corner of the density matrix, valid whenever phases scramble faster than populations change.
What sets the coherence decay rate γ, and why is it Γ over 2?
Two things add into . First, spontaneous emission: since the coherence is an amplitude and the excited population is a probability (amplitude squared), the amplitude decays at half the rate, so radiative decay alone gives . Second, pure dephasing from collisions or field fluctuations, which randomize the phase without changing populations, adds directly: . In magnetic-resonance language these are the two relaxation times, (longitudinal) and (transverse), with ; pure dephasing is what pushes below its radiative ceiling.
Can a system start pure and become mixed on its own?
Not under closed, unitary evolution — the Liouville–von Neumann equation conserves the eigenvalues of , hence its purity: a truly isolated state that starts pure stays pure forever. Mixedness arises only two ways: you add relaxation by hand (shorthand for coupling to a reservoir), or you entangle with another system and trace it out. Spontaneous emission is the textbook case — the atom entangles with the photon field and, considered alone, becomes mixed even though atom-plus-field remains pure. So decoherence is never spontaneous in a closed universe; it is always the shadow of a correlation with something you stopped tracking.