Derivation of the Canonical Distribution from the Microcanonical Ensemble
The microcanonical ensemble is the bedrock: an isolated system of fixed energy, with the single postulate that every accessible microstate is equally likely. The canonical ensemble is the workhorse: a system at fixed temperature, with microstate probabilities weighted by the Boltzmann factor . These look like two different theories — one democratic (all states equal), the other exponentially biased. This article shows they are the same theory: the Boltzmann distribution is derived, not postulated, from the microcanonical bedrock, simply by taking a small system and putting it in contact with a large one. The trick is a change of viewpoint. Take a small system and surround it with a huge reservoir . Together, form an isolated whole with fixed total energy — a microcanonical system, to which the equal-a-priori postulate applies. Now ask: what is the probability that sits in a specific microstate ? It is proportional to the number of ways the reservoir can accommodate the leftover energy . Because the reservoir is enormous, its entropy is a smooth function of energy, and expanding it to first order in the small system energy produces the exponential: , with the reservoir's inverse temperature. That is the entire content of the canonical ensemble, and it explains why temperature appears where energy was: the reservoir's imprints itself on the system. The derivation also reveals its own limits: the linear (first-order) expansion is exact only because the second-order term is suppressed by the reservoir's size, . This article carries out the reservoir expansion carefully, identifies as inverse temperature, quantifies why the expansion is exact, and checks the whole thing numerically on two coupled Einstein solids where the small one is driven to a Boltzmann distribution by the large one.
- The canonical (Boltzmann) distribution is derived from the microcanonical postulate by coupling a small system to a large reservoir and treating as isolated.
- The probability of system microstate is — the number of reservoir states compatible with it.
- Expanding the reservoir entropy (not ) to first order: , so .
- The coefficient is inverse temperature: — the reservoir imprints its temperature on the system.
- The expansion is exact because the second-order term is suppressed by : only an infinite reservoir gives a pure exponential.
- Key idea: the Boltzmann distribution is not an axiom but a consequence — expanding a large reservoir's entropy to first order in the system energy turns the microcanonical postulate into .
Coupling a small system to a large reservoir and applying the microcanonical equal-a-priori postulate to the isolated whole yields the canonical distribution: , and expanding the reservoir entropy to first order gives with . The exponential is exact because the second-order term vanishes as .
Where this lives today
This derivation is the logical spine that connects the two most-used ensembles, and its ideas recur wherever "temperature control" must be implemented. In molecular-dynamics simulations, a real system of a few thousand atoms is coupled to a thermostat — a mathematical reservoir (Nosé–Hoover, Langevin, Andersen) — precisely to sample the canonical distribution rather than the microcanonical one; the thermostat algorithms are engineered reservoirs, and understanding their subtle finite-size artifacts requires exactly the second-order corrections this article quantifies. Getting the reservoir coupling wrong biases every computed free energy. The reservoir picture also underlies the modern theory of open quantum systems and quantum thermodynamics. A qubit in contact with a thermal bath relaxes to the quantum canonical state by exactly the reasoning here, generalized to density matrices; the theory of thermalization (the eigenstate thermalization hypothesis) asks how a large isolated quantum system can act as its own reservoir for its subsystems, deriving canonical behaviour from microcanonical (unitary) dynamics. This is one of the deepest current questions in statistical physics: how the Boltzmann distribution — here derived by coupling to an external bath — emerges for a subsystem of a closed, isolated quantum world. The humble reservoir expansion is the classical shadow of that profound quantum-thermalization program, and it remains the cleanest demonstration that the exponential Boltzmann weight is not a postulate but a consequence of counting states.
The physical picture
Start from the one postulate of the microcanonical ensemble: for an isolated system of fixed energy, all accessible microstates are equally likely. Now the small system we care about is not isolated — it exchanges energy with its surroundings. So enlarge the box: consider system + reservoir together as one isolated whole. That combined system is microcanonical, and the postulate applies to it. Every microstate of the whole — every way of splitting the fixed total energy between and — is equally likely.
Here is the pivot. Fix the small system in a definite microstate of energy — that is one state of , so it carries no multiplicity of its own. But the reservoir can then be in any of microstates, all equally likely. So the probability that is in state is proportional to : the system prefers low-energy states not because they are intrinsically favoured, but because leaving more energy for the reservoir gives the reservoir more ways to arrange itself. The exponential bias of the canonical ensemble is really the reservoir's entropy talking. Why an exponential, specifically? Because is astronomically steep, but its logarithm — the entropy — is smooth and nearly linear over the tiny energy range the small system samples. Expand to first order and you get , so . The punchline plot below shows this: the reservoir's entropy curve is gently sloped, and its local slope — evaluated at — is exactly the inverse temperature that the reservoir imprints on the system. Temperature is the slope of the reservoir's entropy.
The core equations
The starting point is the microcanonical probability of a system microstate, proportional to the reservoir multiplicity:
where: — probability of system microstate ; — reservoir multiplicity; — reservoir entropy; — fixed total energy. The reservoir entropy in the exponent is what will be expanded. Expanding the reservoir entropy (smooth, unlike ) to first order in the small energy :
where: the first-order term is linear in ; the second-order term is the curvature. The reservoir's largeness is what makes the linear term dominate. Identifying the linear coefficient as inverse temperature gives the Boltzmann distribution:
where: — the reservoir's inverse temperature (from ); — the normalizing partition function. The canonical distribution is derived, not assumed. The second-order term measures the error, and it is suppressed by the reservoir size:
where: — number of degrees of freedom in system and reservoir. The curvature term (related to the reservoir's finite heat capacity) vanishes as the reservoir grows, so the exponential is exact only for an infinite reservoir.
The goal is to derive the canonical probability from the microcanonical postulate applied to system-plus-reservoir, and to show that is exactly the reservoir's inverse temperature. The strategy is to expand the reservoir entropy (not the steep multiplicity) to first order and identify the linear coefficient thermodynamically. We use the ideal-gas reservoir to make the coefficient explicit.
Step 1. By the equal-a-priori postulate for the isolated whole, . Write this as so we can expand the smooth entropy rather than the astronomically steep . Why: varies by factors of over tiny energy ranges, so a Taylor expansion of diverges; the entropy is smooth and extensive, and its expansion converges.
Step 2. Taylor-expand: . The constant is absorbed into the normalization, leaving . Why: only the -dependent term matters for the relative probabilities; the constant reservoir entropy at the full energy is the same for every system state.
Step 3. Identify the coefficient. The thermodynamic definition of temperature is , so . Hence , with the reservoir's inverse temperature. For a monatomic ideal-gas reservoir, gives , and with this is exactly — a concrete check. Why: the slope of the reservoir's entropy versus energy is the inverse temperature; the reservoir stamps its onto the small system's distribution.
Step 4. Normalize: with . This is the canonical ensemble, obtained purely from the microcanonical postulate plus the largeness of the reservoir. Why: dividing by the sum enforces ; the whole canonical formalism is the microcanonical postulate seen from the small system's perspective. *Verified: for the ideal-gas reservoir, with , confirmed symbolically in verify_aq-sm-canonical-from-microcanonical.py.*
Go deeper · Derivation B · 2 minWhy the linear expansion is exact — the owned result on the second-order term
This is the article's owned structural result: the reservoir expansion is not merely a convenient approximation but becomes exact in the reservoir limit, because the second-order (curvature) term is suppressed by the ratio and vanishes as the reservoir grows. The goal is to compute the second-order term explicitly and show it dies. The strategy is to keep the quadratic term in the entropy expansion and estimate its size relative to the linear term for an ideal-gas reservoir.
Step 1. Keep two terms: , where . For the ideal-gas reservoir , so and (negative — the entropy is concave). Why: differentiating the reservoir entropy twice gives a curvature inversely proportional to and proportional to — the reservoir's finite heat capacity.
Step 2. Form the ratio of the quadratic to the linear term at a typical system energy : . With and , this is . Why: the two energy scales are set by the numbers of degrees of freedom, so their ratio is the ratio of system to reservoir sizes — small when the reservoir is large.
Step 3. Take the reservoir limit at fixed and : the ratio , so the quadratic (and all higher) terms vanish and exactly. The Boltzmann distribution is exact for an infinite reservoir, not merely approximate. Why: an infinite reservoir has infinite heat capacity, so absorbing the system's energy does not change its temperature at all — the slope is truly constant, and the expansion terminates at first order.
Step 4. Physical reading of the corrections. For a finite reservoir the residual curvature reflects the reservoir cooling slightly as it absorbs energy; this is the origin of small canonical-vs-microcanonical differences that scale as . Why: a finite bath has a finite heat capacity, so its temperature is not perfectly rigid; the second-order term encodes exactly this back-reaction, which disappears only in the idealized infinite-reservoir limit. *Verified: for the ideal-gas reservoir the 2nd/1st-order term ratio equals ; two coupled Einstein solids (small , large ) drive the small system to a Boltzmann distribution — the slope of matches and matches the canonical within , in the verify script.*
Limiting cases
The derivation across regimes:
| Case | Result | Meaning |
|---|---|---|
| Infinite reservoir | exactly | The pure canonical ensemble; reservoir temperature perfectly rigid. |
| Finite reservoir | corrections | Small deviations from Boltzmann; the bath cools slightly as it gives up energy. |
| System = reservoir size | expansion invalid | No separation of scales; must treat the whole microcanonically. |
| Ideal-gas reservoir | The slope of vs is explicitly . | |
| Zero coupling | isolated system | Microcanonical; no energy exchange, no Boltzmann weighting. |
Worked examples
1 · Two coupled Einstein solids drive the small one to Boltzmann (a real emergence)
A small Einstein solid ( oscillators) is coupled to a large one () sharing energy quanta. Show that the small system's energy distribution is Boltzmann, and find its effective temperature (Einstein solid ).
Step 1. The probability the small solid holds quanta is , by the microcanonical postulate on the combined solid. Enumerate: , .
Step 2. The reservoir's inverse "temperature" per quantum is . With and : per quantum.
Step 3. Predicted Boltzmann distribution: . Numerically (in the verify script) the slope of against is , confirming the small system samples its states with a Boltzmann weight set by the reservoir — even though nothing was postulated about temperature.
Step 4. Mean energy: canonically quanta, matching the direct microcanonical average within a few percent. A large "dumb" reservoir, obeying only equal-a-priori probabilities, forces a small system into the exponential Boltzmann distribution — the canonical ensemble emerging from the microcanonical, computed explicitly.
2 · Identifying β for an ideal-gas reservoir (exam level)
A small system is in contact with a monatomic ideal-gas reservoir of atoms and total energy (with ). (a) Compute . (b) Verify it equals . (c) Estimate the size of the neglected second-order term for atom, .
Step 1. Ideal-gas multiplicity scales as , so and .
Step 2. The reservoir energy is (equipartition). Substitute: . Confirmed: the slope of the reservoir entropy is exactly the inverse temperature.
Step 3. Second-order term ratio . The curvature correction is one part in — utterly negligible.
Step 4. Interpretation. For a macroscopic reservoir the Boltzmann distribution is exact to twenty-one decimal places; the "approximation" of truncating at first order is, for all practical purposes, an identity. Only for a pathologically small "reservoir" (comparable in size to the system) would the corrections matter — and then the canonical ensemble simply does not apply.
Origins · 1 minheat reservoir and how this was discovered
The heat reservoir (or heat bath) is the idealization at the heart of the canonical ensemble: a system so large that it can exchange arbitrary amounts of energy with a smaller system while its own temperature remains fixed. It is the thermodynamic analogue of an infinite ocean into which you can pour any amount of heat without warming it. Formally, a reservoir has infinite heat capacity, so its inverse temperature is constant — and it is precisely this constancy that makes the reservoir-entropy expansion terminate at first order, producing the pure exponential Boltzmann weight. The concept crystallized with Gibbs's ensemble formalism (1902): the canonical ensemble is the statistics of a system in contact with a heat reservoir. Every real thermostat — a water bath, a cryostat, the atmosphere, a computer's thermostat algorithm in molecular dynamics — is an approximation to an ideal reservoir. The reservoir is where the arrow of "temperature control" enters statistical mechanics, and understanding that the Boltzmann factor is the reservoir's entropy in disguise is the conceptual key to the entire canonical formalism.
Going further
References. Reif, Fundamentals of Statistical and Thermal Physics, Ch. 6 (the classic reservoir derivation) · Pathria & Beale, Statistical Mechanics, 3rd ed., Ch. 3 · Kardar, Statistical Physics of Particles, §4.2 · Schroeder, An Introduction to Thermal Physics, Ch. 6 · Sethna, Statistical Mechanics, Ch. 6 · Landau & Lifshitz, Statistical Physics Part 1, §28.
Provenance. The reservoir derivation of the canonical distribution is standard (Reif Ch. 6; Schroeder Ch. 6). A verifier should reproduce: ; the first-order entropy expansion with (checked on the ideal-gas reservoir with ); the second-order suppression ; and the two-Einstein-solid emergence of the Boltzmann distribution ( matches ). Numerical instances are recomputed in verify_aq-sm-canonical-from-microcanonical.py.
Builds on: The Microcanonical Ensemble and the Postulate of Equal a Priori Probabilities · Boltzmann Entropy · Temperature, Pressure, and Chemical Potential as Entropy Derivatives. Leads to: Canonical Ensemble · Boltzmann Factor · Canonical Partition Function · Helmholtz Free Energy from the Partition Function · Energy Fluctuations in the Canonical Ensemble · Grand Canonical Ensemble.
Why does the small system prefer low-energy states if all microstates of the whole are equally likely?
This is the beautiful subtlety of the derivation. It is true that all microstates of the combined system-plus-reservoir are equally likely — no state is intrinsically favoured. But when you ask about the small system alone, you must count how many combined states correspond to each small-system state. If the small system takes a low energy, it leaves more energy for the reservoir, and a reservoir with more energy has vastly more microstates available (its multiplicity rises steeply with energy). So low-energy states of the small system are compatible with more equally-likely reservoir arrangements, and are therefore more probable — not because they are preferred, but because they leave the reservoir more room. The exponential bias of the Boltzmann factor is entirely the reservoir's entropy talking: the small system "wants" to give energy to the reservoir because that maximizes the total number of arrangements, which is just entropy maximization in action.
Where exactly does temperature come from in this derivation?
Temperature enters as the slope of the reservoir's entropy versus energy, and nowhere else. When you expand the reservoir entropy to first order in the small system's energy , the linear coefficient is . The thermodynamic definition of temperature is precisely , so that coefficient is (in units where you divide by , it is ). This is profound: the small system has no temperature of its own in the derivation — temperature is a property of the reservoir, and it gets imprinted on the small system's distribution through the coupling. Two systems in contact with the same reservoir end up with the same regardless of their internal structure, which is exactly the zeroth law (thermal equilibrium is transitive) emerging from the reservoir picture. So temperature is not something the small system possesses; it is something the reservoir stamps onto it.
What is the difference between this derivation and just postulating the Boltzmann distribution?
Logically, everything. If you postulate , you have to accept the exponential form and the meaning of on faith, and you have two independent postulates (microcanonical equal-a-priori and canonical Boltzmann) that might seem unrelated. This derivation shows they are the same postulate viewed from different vantage points: the canonical Boltzmann distribution is a theorem, provable from the single microcanonical postulate plus the mathematical fact that a large reservoir's entropy is smooth and nearly linear over the range the small system explores. It also explains the two things a postulate leaves mysterious: why the weight is exponential (because the reservoir entropy is linear, and is exponential) and why is inverse temperature (because it is the slope of the reservoir entropy, which is by definition). A derivation that reduces two postulates to one and explains the form of the result is far more satisfying — and far more illuminating about the why — than a postulate.
Does this mean the canonical ensemble is only an approximation to the microcanonical one?
For a finite reservoir, yes — there are small corrections of order . But in the idealized reservoir limit (), the canonical distribution is exact, and for any realistic macroscopic reservoir the corrections are so tiny (one part in or smaller) that "approximation" is a technically-true-but-misleading word. More importantly, the two ensembles give identical thermodynamic predictions for large systems — this is ensemble equivalence. The canonical energy fluctuates while the microcanonical is fixed, but the fluctuations are relatively negligible (), so every thermodynamic quantity (energy, entropy, free energy, pressure) comes out the same. So it is not that one ensemble is "right" and the other "approximate"; they are two equally valid descriptions that agree in the thermodynamic limit, connected by exactly this reservoir derivation. You choose whichever is more convenient — usually canonical, because fixed temperature is easier to work with than fixed energy.
Can a system be its own reservoir? What if there's nothing external?
This is one of the deepest questions in modern statistical mechanics, and the answer is a qualified yes. For a large isolated system, any small subsystem can be treated canonically, with the rest of the system acting as its reservoir — you simply designate part of the whole as "system" and the remainder as "bath," and the derivation goes through. This is how the Boltzmann distribution emerges for local degrees of freedom even in a completely closed, isolated system: the vast number of other degrees of freedom serve as the reservoir. In quantum mechanics this idea is formalized by the eigenstate thermalization hypothesis (ETH), which proposes that a single energy eigenstate of a large chaotic quantum system already looks thermal (canonical) when you examine any small subsystem, so an isolated quantum system can thermalize its own parts through unitary evolution alone — no external bath needed. This resolves an old puzzle: how can a closed system, whose total dynamics is reversible and never increases entropy, exhibit thermal (irreversible-looking) behaviour in its subsystems? The answer is that the rest of the system is the reservoir. So "there is nothing external" does not prevent canonical behaviour — it just means the reservoir is internal.
Why must the reservoir be much larger than the system?
Because the derivation relies on the reservoir's temperature being essentially unchanged when it exchanges energy with the system — and that requires the reservoir to have a much larger heat capacity, i.e. many more degrees of freedom. Quantitatively, the neglected second-order term in the entropy expansion scales as , the ratio of system to reservoir sizes. If the reservoir is much larger (), this ratio is tiny and the linear expansion — hence the pure exponential Boltzmann weight — is essentially exact. If the "reservoir" is comparable in size to the system, the ratio is order one, the second-order (curvature) term is significant, and the distribution is not a clean Boltzmann exponential: the effective temperature shifts as energy flows, because the small "reservoir" noticeably cools when it gives up energy. In that case there is no separation of scales, no fixed temperature, and you must treat the combined system microcanonically. So the largeness of the reservoir is exactly what guarantees a rigid temperature and a pure canonical distribution; it is the mathematical condition for "temperature control" to make sense.