Method of the Most Probable Distribution
How does a gas "decide" how to spread its energy among molecules? It does not decide at all — it simply lands, overwhelmingly often, in the arrangement that can be built the greatest number of ways. That single idea, made quantitative, is Boltzmann's combinatorial route to equilibrium statistical mechanics: the method of the most probable distribution. Partition the available single-particle states into groups labelled by energy, assign occupation numbers , and count the microstates that realize each choice. By the fundamental postulate of equal a priori probabilities every microstate is equally likely, so the most probable macrostate is the one with the largest . Equilibrium is then, by definition, the distribution that maximizes — or equivalently , which is why maximizing multiplicity is maximizing entropy. The physical constraints enter through Lagrange multipliers. Conservation of particle number brings a multiplier ; conservation of energy brings a multiplier . The stationarity condition delivers the equilibrium occupation numbers in closed form, and comparison with thermodynamics fixes and . Feed in three different counting rules and the same maximization produces the three great distributions of statistical physics: Maxwell–Boltzmann for distinguishable (or dilute) particles, Bose–Einstein for indistinguishable particles with unrestricted occupancy, and Fermi–Dirac for particles obeying the Pauli exclusion principle. The legitimacy of replacing an entire ensemble by a single distribution rests on the astonishing sharpness of the maximum. Because is extensive () while the width of its peak grows only as , the relative fluctuation about the most probable distribution vanishes as . For that is a part in : the most probable distribution, the mean distribution, and essentially every distribution carrying non-negligible weight all coincide. This is precisely why Boltzmann's combinatorics reproduces, term for term, the canonical and grand-canonical ensemble results that Gibbs would later derive more formally — the method is both the historical foundation and a transparent, physically motivated shortcut.
- The method identifies equilibrium as the set of occupation numbers that maximizes the multiplicity — the number of microstates realizing a macrostate — subject to fixed total particle number and total energy.
- Maximizing with Lagrange multipliers (for ) and (for ) yields the equilibrium distribution; the multipliers acquire thermodynamic meaning , .
- The same maximization, with three different counting rules for , produces Maxwell–Boltzmann (), Bose–Einstein ( in the denominator), and Fermi–Dirac ().
- The maximum is overwhelmingly sharp: the curvature makes fluctuations Gaussian with relative width , so one distribution stands in for the whole ensemble.
- The result coincides with the canonical/grand-canonical ensemble averages, providing the historical bridge from Boltzmann's combinatorics to Gibbs's ensemble theory.
- Key idea: Equilibrium is the macrostate of maximum multiplicity. Maximize over occupation numbers under and using Lagrange multipliers ; the stationarity condition delivers the equilibrium distribution, and the sharpness of the peak (relative width ) makes that single distribution effectively the entire ensemble.
Equilibrium is the macrostate of maximum multiplicity. Maximize over occupation numbers under the constraints and using Lagrange multipliers ; the stationarity condition delivers the equilibrium distribution, and the sharpness of the peak (relative width ) makes that single distribution effectively the entire ensemble.
Where this lives today
Every time a computational chemist evaluates a partition function, or a semiconductor engineer computes the carrier density in a doped crystal, they are using the equilibrium distributions this method produces. The Fermi–Dirac occupancy is the workhorse of solid-state electronics — it sets the position of the Fermi level, the carrier statistics in transistors, and the thermionic emission from cathodes. The Bose–Einstein occupancy, applied to photons (), is Planck's blackbody law, and applied to trapped ultracold atoms it predicts the Bose–Einstein condensate first realized in 1995 (Nobel Prize 2001). The method also illuminates exotic states. For a system with a bounded energy spectrum — such as nuclear spins in a magnetic field — maximizing at high energy yields population inversion and a negative absolute temperature (), hotter than any positive temperature. Negative-temperature spin states, and more recently negative-temperature motional states of cold atoms in optical lattices, are direct experimental realizations of what happens when decreases with energy — a scenario the most probable distribution method makes completely transparent.
The physical picture
Imagine distributing identical coins among many boxes labelled by energy. Configurations that pile every coin into one box are rare; configurations that spread the coins broadly are overwhelmingly numerous. Equilibrium is simply the spreading pattern realizable in the largest number of ways — it is multiplicity, not energy, that is being maximized, with energy entering only as a constraint that tilts the balance toward lower-energy boxes. The Lagrange multipliers are just the "prices" of the conserved quantities. The multiplier is the marginal entropy cost of adding energy — it has to equal — and is the cost of adding a particle, which fixes the chemical potential. When two systems touch and exchange energy, they equalize : that is the zeroth law. When they also exchange particles, they equalize : that is chemical equilibrium. The abstract multipliers are the temperature and chemical potential in disguise.
The only difference between Maxwell–Boltzmann, Bose–Einstein, and Fermi–Dirac statistics is the counting rule fed into . Bose counting lets any number of indistinguishable particles share a state; Fermi counting caps occupancy at one, enforcing Pauli exclusion; Maxwell–Boltzmann treats particles as distinguishable (or the states as dilutely occupied). Same maximization, three combinatorial inputs, three distributions — a remarkable economy of principle.
The core equations
Start by counting. For distinguishable particles distributed with in each group (each group holding single-particle states), the number of ways is a multinomial times the ways of placing particles among the states within each group.
where: — number of microstates realizing the macrostate ; — total particles; — occupation of group ; — degeneracy (number of single-particle states) in group . Reading it physically: the multinomial counts which particles land in which group; the counts which state within the group each takes. The physics enters as two conservation laws that the distribution must respect.
where: — single-particle energy of group ; — fixed total energy. Reading it physically: these constraints are what prevent the trivial answer (pile everything into the lowest state) — energy conservation forces some spread. Because the are not independent, we cannot just set . We attach the constraints with undetermined multipliers and extremize the combination freely.
where: — multiplier for particle number, later ; — multiplier for energy, later . Reading it physically: and are the marginal "prices" of a particle and a unit of energy, respectively. To differentiate we need as a smooth function, which Stirling's approximation provides by turning factorials into logarithms.
where: the linear terms from Stirling on and each cancel because . Reading it physically: this is as a function of the occupation numbers — the object whose maximum defines equilibrium. Extremizing (4) under the constraints gives the Maxwell–Boltzmann distribution — an exponential in energy.
where: — normalization fixing (related to fugacity); — the Boltzmann factor. Reading it physically: occupancy falls off exponentially with energy, at a rate set by . The multipliers are not free parameters; thermodynamics pins them down through .
where: — absolute temperature; — chemical potential. Reading it physically: is inverse temperature, and carries the chemical potential — equality of these across subsystems is thermal and diffusive equilibrium. Change the counting rule and the same method yields quantum statistics. Bose–Einstein allows unlimited occupancy; Fermi–Dirac allows at most one per state.
where: BE counts indistinguishable particles in "bins" with repetition allowed; FD counts choices of occupied states out of (each at most once). Reading it physically: the two combinatorial forms encode the two ways nature lets identical particles share states. Maximizing (7) under the same constraints collapses both into a single master formula.
where: — Fermi–Dirac; — Bose–Einstein. Reading it physically: the lone sign in the denominator is the entire mathematical difference between fermions and bosons, and it produces degeneracy pressure on one side and Bose condensation on the other.
Derivations
We maximize the Boltzmann-corrected multiplicity under the number and energy constraints to obtain the exponential distribution . The strategy is to write via Stirling as a smooth function of the occupation numbers, attach the two constraints with Lagrange multipliers so the can be varied independently, differentiate level by level, and solve; the payoff is that the same three-line calculation, with a different , will later give the quantum distributions too.
Step 1. From equation (4), . Form the constrained functional .
Step 2. Differentiate with respect to a single : . Why the cancels: supplies a , while (since ) supplies a ; they annihilate, leaving .
Step 3. Solve: .
Step 4. Fix the multipliers. Imposing defines the single-particle partition function , so ; the thermodynamic identification gives , hence . Verified: symbolic solve of the stationarity condition returns exactly ; the result equals the canonical single-particle Boltzmann weight (Pathria & Beale Ch. 3).
Go deeper · Derivation B · 1 minSharpness of the maximum: Gaussian fluctuations and the 1/√N law
We expand to second order about its maximum to prove that the relative width of the peak scales as — the structural result that justifies replacing the entire ensemble by the single most probable distribution. The strategy is to write , use the fact that the first-order term vanishes on the constraint surface, compute the curvature explicitly, and read off the variance of the fluctuations; the conclusion is that for macroscopic the peak is a needle so thin it may as well be a delta function.
Step 1. Taylor expand: . The first-order coefficient is , and the constrained variations satisfy and , so the linear term vanishes.
Step 2. Compute the curvature. From the piece, . Why this is the whole story: only the diagonal curvature survives at leading order, and it is uniformly negative, confirming a genuine maximum.
Step 3. Hence — a Gaussian with variance , so .
Step 4. Since typical , relative fluctuations . For this is : the most probable distribution dominates so completely that it is equilibrium. Verified: symbolic curvature ; numeric binomial widths confirm relative width for –; consistent with Poisson statistics in the classical limit (Reif §6).
Go deeper · Derivation C · 1 minBose–Einstein and Fermi–Dirac distributions from the same method
We apply the identical variational procedure to the quantum multiplicities and to obtain the distributions, showing that the only thing that changes is the combinatorial input. The strategy mirrors the MB derivation — Stirling, Lagrange, differentiate, solve — but with the Bose "bins-with-repetition" count and the Fermi "at most one per state" count, and the punchline is that a single sign flip in the final denominator separates all of quantum statistics.
Step 1 (Bose). With , . Extremizing gives .
Step 2 (Bose result). Solve: — the Bose–Einstein distribution, with the telltale .
Step 3 (Fermi). With occupancy capped at , . Extremizing gives .
Step 4 (Fermi result). Solve: — the Fermi–Dirac distribution, with the that enforces . Why one sign matters so much: the caps occupancy (Pauli), giving degeneracy pressure and the linear electronic heat capacity; the lets occupancy diverge as , giving Bose–Einstein condensation.
Step 5. When (dilute/non-degenerate limit) both reduce to , recovering Maxwell–Boltzmann. Verified: symbolic solve returns for BE/FD; the classical limit agrees with MB to under 1%; the FD occupancy entropy peaks at at (Landau–Lifshitz §53–55).
Limiting cases
The master result specializes cleanly:
| Case | Result | Meaning |
|---|---|---|
| Maxwell–Boltzmann | Classical / dilute limit, valid when , i.e. occupancy per state. | |
| Bose–Einstein | Indistinguishable, unrestricted occupancy; requires . Bose condensation appears as . | |
| Fermi–Dirac | Pauli exclusion, occupancy ; at a step at the Fermi energy . | |
| Thermodynamic limit | Most probable distribution equals the mean; fluctuations negligible, validating the whole method. |
Worked examples
Example 1 — The equilibrium of a two-level system by direct counting. Take distinguishable particles, each either in a ground state () or an excited state (). Find the most probable number in the excited state (i) with no energy constraint and (ii) with a Boltzmann weight , then read off the single-particle occupancy.
Step 1. Multiplicity of " excited" is . With no energy constraint, is maximized where peaks, i.e. at — equal populations, the infinite-temperature () state.
Step 2. Now weight each configuration by energy: the equilibrium mean is . Computing with gives .
Step 3. For independent two-level particles the single-particle excited occupancy is , so — the direct count and the closed-form agree exactly. The most probable excited population drops from 20 (no energy cost) to 12.40 (with ), and the two independent calculations match to all figures — the method delivers a real number, not just a formula.
Example 2 — Sharpness of the peak for a macroscopic gas. Estimate the relative fluctuation of the occupation of a typical energy level for particles, and interpret it.
Step 1. From the Gaussian result, . For a typical level with ; take as a representative macroscopic occupancy.
Step 2. Then .
Step 3. Interpret: a level holding particles fluctuates by only about particles — one part in a billion. No measurement of a macroscopic gas could ever resolve a deviation from the most probable distribution. The relative fluctuation is , confirming that for macroscopic the most probable distribution is equilibrium to a precision far beyond any experiment.
History band
Origins · 1 minLudwig Boltzmann and how this was discovered
Going further
References. Pathria & Beale, Statistical Mechanics, 3rd ed., Ch. 3 & 6 · Kardar, Statistical Physics of Particles, Ch. 4 & 7 · Reif, Fundamentals of Statistical and Thermal Physics, Ch. 6 & 9 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, Ch. 3 & 7 · Landau & Lifshitz, Statistical Physics Part 1, §7, §40, §53–55.
Provenance. All distributions, multiplicities, and the Lagrange-multiplier derivation are standard and recomputable: verify the MB derivation against Pathria & Beale Ch. 3, the BE/FD multiplicities and distributions against Pathria Ch. 6 and Landau–Lifshitz §53–55, the sharpness-of-maximum argument against Reif Ch. 6, and Stirling's approximation . The identifications , follow from with . The two-level worked example (, ) gives by both direct summation and the closed form ; this and all other numbers are independently recomputed. No non-standard numbers are asserted.
Builds on: Microstates and Macrostates · Fundamental Postulate of Equal A Priori Probabilities · Accessible Phase Space and Energy Shells · Boltzmann Entropy Leads to: Statistical Ensembles · Gibbs Entropy
Why maximize ln W instead of W itself?
They have the same maximizer — is monotonic — but is vastly easier to work with. is an astronomically large product of factorials (), impossible to differentiate directly. Taking the log turns the product into a sum, and Stirling's approximation then turns each into the smooth , giving a differentiable function you can extremize with calculus. Physically, is also the more natural object: it equals , so maximizing is literally maximizing entropy.
Where does the Boltzmann factor actually come from here?
It falls straight out of the maximization. Differentiating under the energy constraint gives , and exponentiating yields . The is not assumed — it is forced by the requirement that the distribution maximize multiplicity while conserving energy. The multiplier multiplies precisely because energy is the constrained quantity, and thermodynamics then identifies . So the exponential decay of occupancy with energy is a theorem about counting, not a postulate.
Do I use the same and for bosons, fermions, and classical particles?
The roles are identical — always, and always — because they are fixed by the same thermodynamic relations and . What differs is only the multiplicity fed into the maximization, and therefore the functional form of the resulting occupancy: (MB), (BE), (FD). Same multipliers, same constraints, three counting rules.
Is the "most probable distribution" the same as the canonical ensemble average?
In the thermodynamic limit, yes — and that equivalence is the whole point. The canonical ensemble computes averages over all distributions weighted by their probability; the most probable distribution method uses only the single peak. Because the peak's relative width vanishes as , the peak and the weighted average coincide to a part in . So Boltzmann's combinatorial method and Gibbs's ensemble method give identical results for macroscopic systems; they differ only in bookkeeping, and the ensemble method is cleaner for computing fluctuations, which the peak method must handle by expanding around the maximum.
Why does energy conservation need a multiplier but nothing else does?
Only conserved (constrained) quantities get multipliers. In a closed system with fixed and , exactly two things are held fixed, so exactly two multipliers appear — for and for . If the system could also exchange volume or another conserved charge, each would bring its own multiplier (pressure, another chemical potential). Quantities that are not conserved — like the number of photons, which can be created and destroyed — carry no multiplier, which is why photon gases have , i.e. . The count of multipliers is simply the count of independent conservation laws.
How can a temperature be negative in this framework?
Through . For most systems increases with energy, so and . But if the energy spectrum is bounded above — as for two-level spins, whose maximum energy is all-excited — then rises, peaks, and falls as approaches its maximum. On the falling side , so and the absolute temperature is negative. Such states are genuinely hotter than : put them in contact with any positive-temperature system and heat flows out of them. The method makes this transparent because is manifestly the slope of .