Indistinguishability and the Gibbs Paradox
Pour two identical glasses of water together and you have one larger glass of water — nothing happened, and no engine could ever extract work from the act. Now pour a glass of water into a glass of alcohol and the mixture warms, refuses to unmix, and could in principle drive a turbine as it settles. Thermodynamics draws a sharp line between these two: mixing identical substances is free and reversible, mixing different substances creates entropy. The trouble is that the most natural way to count microstates of a classical gas erases that line — it charges you an entropy of mixing even when nothing distinct was mixed. The culprit is bookkeeping. If you imagine tagging every molecule with a serial number and counting configurations that differ only by swapping tags as genuinely different, the microstate count inflates by a factor that grows with . That inflation shows up as a rogue in the entropy where thermodynamics demands the intensive combination . The first form is not extensive: double the whole system and the entropy more than doubles. Josiah Willard Gibbs pinned the absurdity down with a partition removed between two boxes of the same gas — the labelled count predicts a spurious for a process in which, physically, nothing changed. The resolution is one factor: divide the phase-space volume by , the number of ways to permute identical particles, because swapping identical particles is not a new microstate at all. That single division converts into , restores extensivity, produces the Sackur–Tetrode entropy that matches measured absolute entropies of the noble gases, and — the payoff — makes the mixing entropy of identical gases exactly zero while leaving the for genuinely distinct gases untouched. The is not a units patch; it is the classical fossil of quantum indistinguishability, the statement that identical particles have no individuality to keep track of.
- Counting a classical ideal gas as if particles carried labels gives a non-extensive entropy: doubling , , together fails to double .
- Gibbs's thought experiment: removing a partition between two boxes of the same gas predicts a spurious , an entropy of mixing where no mixing occurred.
- The cure is a single factor on the phase-space volume, because permuting identical particles is the same microstate, not a new one.
- With the entropy becomes the extensive Sackur–Tetrode formula, and the mixing entropy of identical gases is exactly zero.
- For genuinely distinct gases (argon vs. neon) there are no cross-permutations to remove, so survives — the correct, measurable result.
- The is the classical limit of quantum statistics: in the dilute regime both Bose and Fermi counting collapse to the Maxwell–Boltzmann count divided by .
- Key idea: Permuting identical particles is not a new microstate; dividing the classical phase-space volume by restores extensivity, yields Sackur–Tetrode, and turns the mixing entropy of identical gases into an exact zero while distinct gases keep their .
Permuting identical particles does not generate a new microstate; dividing the classical phase-space volume by (and measuring it in units of ) restores extensivity, yields the Sackur–Tetrode entropy, and makes the entropy of mixing of identical gases vanish exactly — while distinct gases keep the real .
Where this lives today
The Gibbs correction is not a museum piece; it is the reason chemical thermodynamics works. Every tabulated standard molar entropy of a gas — the numbers chemists use to predict whether a reaction runs — rests on the Sackur–Tetrode formula and its , and the sub-percent agreement with argon at room temperature is checked routinely. The distinction between mixing identical and distinct species is engineered directly in separation technology: semipermeable membranes, pressure-swing adsorption, and isotope separation all trade on the fact that mixing entropy is extractable as work only for distinguishable species. The deepest modern echo is in quantum information and cold atoms. Experiments with ultracold gases now tune across the classical-to-degenerate crossover, watching the approximation give way to full Bose–Einstein or Fermi–Dirac statistics — the very transition the limiting-cases table anticipates. And the recognition that "indistinguishability" is a statement about state-counting, not about particles being physically interchangeable machines, underlies how entropy is defined for identical qubits and photons in quantum computing.
The physical picture
Picture two boxes side by side, each holding molecules of argon at the same temperature and density, separated by a thin partition. Slide the partition out. If argon molecules were tiny numbered billiard balls, then "which of the balls ended up in the left half" would be new information the joined system now carries, and counting those choices credits the gas with an entropy of mixing . But argon atoms carry no serial numbers. A snapshot with atoms 1 and 2 swapped is not a second photograph of the gas — it is the same photograph. The labelled count is answering a question that has no physical referent, and it is punished with a nonsense entropy for a reversible, do-nothing process. Contrast the honest case. Replace the argon in the right box with neon. Now removing the partition really does open new configurations: every neon atom, formerly confined to volume , can roam the full , and so can every argon atom. That genuine doubling of accessible volume per species is what produces the real, measurable . The whole content of the Gibbs paradox is that a correct theory must return exactly zero in the first case and exactly this value in the second — and the only difference between the two calculations is whether you factor out cross-species permutations that never physically existed.
The picture already contains the whole resolution: entropy of mixing is real if and only if the two populations were genuinely distinguishable. The labelled classical count fails because it invents distinguishability among identical particles. Quantum mechanically there is nothing to repair — the state of identical particles is a single (anti)symmetric vector, so permutations were never separate states. The is precisely what survives of that fact when you let in the dilute regime.
The core equations
The whole subject is one factor of inserted into the partition function. Everything else — extensivity, Sackur–Tetrode, the vanishing of identical-gas mixing — follows by algebra. We begin with the corrected canonical partition function of identical particles, in which the indistinguishability factor sits out front.
where: — canonical partition function for identical particles; — number of particle permutations, removing the over-counting of configurations that differ only by relabelling; — the phase-space cell volume that makes dimensionless; ; — the Hamiltonian. The is the entire content of the Gibbs correction. For non-interacting particles the integral factorizes into one-particle pieces. Each free particle contributes a spatial factor and a Gaussian momentum integral that defines the thermal de Broglie wavelength — the quantum length scale that will carry Planck's constant into an otherwise classical entropy.
where: — single-particle partition function; — volume; — thermal de Broglie wavelength; — particle mass. When is small compared to the interparticle spacing , the gas is classical and is accurate; when they are comparable, quantum statistics takes over. Because the particles do not interact, the -particle partition function is the single-particle one raised to the , divided by the crucial . This is the object whose logarithm we take.
where: — full non-interacting partition function including indistinguishability; — single-particle value from (2). Without the this would be — the labelled count that breaks extensivity. Taking the logarithm and applying Stirling to turns the labelled into the intensive . The Helmholtz free energy inherits that intensive combination.
where: — Helmholtz free energy; — volume per particle, the intensive ratio whose appearance (rather than alone) is the signature of a correctly extensive theory. Differentiating with respect to temperature gives the entropy — the celebrated Sackur–Tetrode formula, extensive by construction, carrying Planck's constant inside the logarithm.
where: — entropy of a monatomic ideal gas; the inside the log and the constant both depend on the having been included. Written in energy variables with this is . The defining test of extensivity is homogeneity of degree one: scale the system up by any factor and the entropy scales by the same factor. The corrected entropy passes; the labelled one does not.
where: — any positive scaling factor. This single equation is what the buys, and what its omission destroys. Finally, the two mixing outcomes that resolve the paradox. Distinct species mix and generate entropy; identical species do not.
where: — number of particles of species ; — mole fraction. For a 50:50 binary mixture the distinct value is per species, totalling for of each; the identical value is an exact zero.
The clean way to see the paradox is to compute the entropy twice — once treating particles as labelled, once with the removed — and test each for extensivity. The failure is not subtle: the labelled entropy contains a term instead of , and under uniform scaling that lone spawns an extra that grows super-linearly. Watching Stirling's approximation of convert into is watching the paradox dissolve in one line.
Step 1. The labelled (naive) count. Treat every particle as carrying a distinct label, so there is no permutation correction: . Why: this is the "obvious" classical count — integrate independently over each of the labelled particles' phase spaces.
Step 2. The labelled entropy. From and one finds
Why: the temperature derivative acts on , producing the ; the volume enters as a bare , with no compensating .
Step 3. Test extensivity. Scale . Because is intensive (it depends only on , which is fixed), the term becomes , giving
Why: the extra is the mathematical face of the Gibbs paradox — grows faster than the system, so it is not extensive, and additivity of entropy for independent subsystems fails.
Step 4. Insert the indistinguishability factor. With , Stirling's approximation (owned by The Stirling Approximation) gives , so :
Why: the from is exactly what pairs with to build the intensive — the same that removes label-permutation over-counting also removes the extensivity defect. This is not a coincidence: they are the same over-counting seen two ways.
Step 5. The corrected entropy is extensive. The Sackur–Tetrode entropy (5) is now homogeneous of degree one: , with the spurious gone. Why: only the intensive survives inside the logarithm, so scaling all extensive variables together leaves the bracket unchanged and multiplies by the prefactor . *Verified: the scaling algebra and the Stirling substitution reproduce Pathria & Beale §1.5–1.6 and Kardar §4.8; checked symbolically in verify_aq-sm-gibbs-paradox.py (homogeneity of Sackur–Tetrode holds, and fails without the ).*
Go deeper · Derivation B · 2 minThe mixing experiment: an exact zero versus a real Nk ln2
This is the calculation Gibbs designed the paradox around, and the owned result of this article: the mixing entropy is discontinuous in the degree of distinguishability. Two boxes, each of volume , temperature , and particles, are joined into one box of volume with particles. Using the extensive Sackur–Tetrode entropy throughout, the identical-gas case gives exactly zero — not approximately, not to leading order — while the distinct-gas case gives . The two answers are separated by a finite gap with nothing in between, and the entire gap is the presence or absence of cross-species permutations.
Step 1. Identical gases, before mixing. Each box separately carries , so the total before is . Why: the two boxes are independent, and entropy is additive once it is extensive.
Step 2. Identical gases, after mixing. The joined system has particles in :
Why: both and doubled, so the intensive ratio inside the log is unchanged — the extensive entropy simply doubled. This is exactly why extensivity was the thing worth fixing.
Step 3. Identical result — exact zero. . Why: removing a partition between identical samples is reversible — slide it back and you recover the start with no trace — so the entropy change must vanish identically, and it does.
Step 4. Distinct gases, count states. Now species A fills the left box, species B the right, . After mixing, each species occupies the full , and permutations are factored out only within a species — there is no across species:
Why: an argon–neon swap genuinely changes the microstate, so those permutations were never over-counting — nothing is removed for them.
Step 5. Distinct result — a real entropy. Each species' volume went from to , contributing :
Why: the honest entropy of mixing is just a free expansion of each species into twice its volume. The paradox is resolved not by making both cases zero, nor both nonzero, but by the theory returning the correct discontinuous jump between them. *Verified: reproduces Reif §7.3 and Landau–Lifshitz §41; the exact zero for identical gases and the for distinct gases are checked symbolically in verify_aq-sm-gibbs-paradox.py.*
Limiting cases
How the correction behaves across regimes — it is exact only where quantum occupations are negligible:
| Case | Result | Meaning |
|---|---|---|
| Dilute / classical | Occupation numbers ; almost no two particles compete for one single-particle state, so the full quantum count reduces to Maxwell–Boltzmann divided by . Here is accurate. | |
| Degenerate | Multiple particles crowd the same states; over-corrects because it cannot handle multiple occupancy. Full Bose–Einstein or Fermi–Dirac statistics is required. | |
| Distinguishable sites | fixed lattice | Atoms pinned to distinct sites are labelled by position; permutations are genuinely different states, so NO is applied (e.g. the Einstein solid, a paramagnet). |
| Mixing identical gases | Extensivity makes removing a partition between identical samples give an exact zero — reversibility respected. | |
| Mixing distinct gases | Different species genuinely mix; for an equal binary mixture , independent of the subtlety because cross-permutations never existed. |
Worked examples
1 · Two moles at the tap — identical versus distinct (the paradox with numbers)
Two rigid boxes each hold one mole () of gas at the same and density, separated by a partition. Compute the entropy of mixing when the partition is removed, first for the same gas on both sides, then for argon on one side and neon on the other.
Step 1. Identical case. With the extensive entropy, doubling both and leaves fixed, so . There is no number to compute — it is an exact zero, and it must be, since sliding the partition back undoes the process with no trace. .
Step 2. Distinct case, per species. Each species free-expands from to : per mole, where .
Step 3. Evaluate. per mole.
Step 4. Total for both moles. . The gulf between and is the Gibbs paradox made quantitative: the same apparatus, the same thermodynamic states, and yet the entropy change leaps from an exact zero to a substantial positive value the instant the two gases become genuinely different. A semipermeable membrane that passes one species but not the other can extract that of mixing free energy as work — while no membrane in the universe can do so for identical gases.
2 · Argon's absolute entropy from Sackur–Tetrode (does the 1/N! survive experiment?)
Compute the molar entropy of argon gas at , from the Sackur–Tetrode formula, and compare with the calorimetric value .
Step 1. Thermal wavelength. With , . Numerically , so .
Step 2. Volume per particle. At , .
Step 3. The logarithm. , so .
Step 4. Molar entropy. . The agreement with the calorimetric value to better than a tenth of a percent is a stunning verification: the (which set the ) and the cell size (which set , and hence put Planck's constant into an "absolute" entropy) are both physically correct, not bookkeeping conveniences. An entropy formula containing matches a room-temperature gas measurement — the quantum origin of indistinguishability is written into the noble gases' thermometry.
Origins · 1 mingibbs paradox and how this was discovered
The paradox is named for Josiah Willard Gibbs, who in his 1875–78 papers on the equilibrium of heterogeneous substances noticed that the entropy of mixing of two gases is independent of how similar they are — right up until they become identical, when it must jump to zero. That discontinuity troubled him: thermodynamics seemed to demand a quantity that did not vary continuously with the "difference" between the gases. The resolution — that particle labels are not physical, so identical-particle permutations must not be counted — was only fully understood after quantum mechanics revealed that identical particles are described by a single (anti)symmetric state. The modern reading is that the is the classical fingerprint of that quantum fact, and the "paradox" is really the theory correctly refusing to interpolate between distinguishable and identical.
Going further
Texts. Pathria & Beale, Statistical Mechanics, 3rd ed., §1.5–1.6 (Gibbs paradox, Sackur–Tetrode) · Kardar, Statistical Physics of Particles, §4.8–4.9 · Reif, Fundamentals of Statistical and Thermal Physics, §7.3 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, §3.5, §7 · Landau & Lifshitz, Statistical Physics Part 1, §40–41.
Provenance. Standard results: the correction and Sackur–Tetrode (Pathria §1.5–1.6; Kardar §4.8–4.9; Reif §7.3; Landau–Lifshitz §40–41). A verifier should: reproduce via the Gaussian momentum integral; confirm Stirling converts into ; check the Sackur–Tetrode entropy is homogeneous of degree one in and is not without the ; verify for identical and for distinct gases; and recover from the small-fugacity expansion of the quantum grand partition function. The one empirical claim — Sackur–Tetrode reproducing argon's molar entropy at 298 K, 1 bar to within experimental error — is a standard textbook comparison, recomputed to in verify_aq-sm-gibbs-paradox.py.
Prerequisites. Phase Space · Microstates and Macrostates · Boltzmann Entropy · Statistical Ensembles · Fundamental Postulate of Equal A Priori Probabilities. Leads to. Gibbs Entropy · Statistical Ensembles · Accessible Phase Space and Energy Shells · Extensivity and Additivity of Entropy · the quantum statistics of identical particles (Bose–Einstein and Fermi–Dirac).
If the particles are "really" identical, why did anyone ever count them as labelled in the first place?
Because classical mechanics has no notion of identity — a classical particle follows a definite trajectory you could, in principle, track and thereby "label" it. So the natural classical count integrates over each particle's phase space independently, treating a swap of two as a new configuration. Nothing in classical physics forbids this; it is only wrong as a description of nature, and the Gibbs paradox is how the error announces itself (non-extensive entropy, spurious mixing). Quantum mechanics removes the temptation at the root: identical particles share a single (anti)symmetric state, so a "swap" is not a different state to begin with. The is the patch that makes the classical count agree with the quantum truth in the dilute limit.
Is the entropy of mixing "real"? Can I actually feel it?
For distinct gases, absolutely — it is measurable work. A semipermeable membrane that passes species A but blocks B lets you unmix them (or harvest work as they mix); the extractable free energy is exactly . For two moles of distinct gases that is , about at room temperature. For identical gases the mixing entropy is exactly zero, and — consistently — no membrane in the universe can distinguish the two sides to extract anything. The reality of the mixing entropy is precisely the reality of being able to tell the species apart.
Why exactly N! and not some other function of N?
Because is the number of distinct ways to permute labels among particles, and every one of those permutations was counted as a separate microstate by the labelled integral even though they are physically the same. Dividing by the number of over-counted copies removes the redundancy exactly. It is the same logic as counting hands of cards: if the order in which you were dealt the cards does not matter, you divide the ordered count by the number of orderings. Here the "order" is the assignment of labels, and there are of them.
Doesn't the 1/N! introduce a problem when N can change, like in the grand canonical ensemble?
No — it works cleanly there, and in fact the grand canonical ensemble is where the looks most natural. The grand partition function is , and that exponential is only summable to a clean closed form because of the Taylor coefficients. Far from causing trouble, the is what makes the ideal-gas grand ensemble exponentiate. When you then compute and fluctuations you recover the correct ideal-gas thermodynamics with an intensive chemical potential .
The article says 1/N! "over-corrects" in the degenerate regime. What does that mean concretely?
The assumes that no two particles ever occupy the same single-particle state, so every -particle configuration corresponds to exactly labelled ones. But when , particles do crowd into the same states. If two particles share a state, there are fewer than distinct labellings (swapping the two in the same state changes nothing), so dividing by the full removes too much. The fix is not a modified factorial but full quantum statistics: Bose–Einstein counting (for integer-spin particles, which cluster) or Fermi–Dirac (for half-integer, which exclude). The is the first term of that exact counting, valid only when multiple occupancy is negligible.
Why does Planck's constant appear in a "classical" entropy formula at all?
Two places, both quantum in origin. The obvious one is the cell size : phase-space volume has units, and to count states you must divide by the volume of one quantum cell, which the uncertainty principle sets at per degree of freedom. The subtler one is that hides inside . Together they fix the absolute (not just relative) entropy — the additive constant that classical thermodynamics leaves undetermined. The fact that Sackur–Tetrode, containing , nails argon's measured absolute entropy is direct evidence that this quantum input is physically correct, not a formal device.
Is the Gibbs paradox actually a paradox, or just a mistake?
It is a mistake dressed as a paradox — and that framing is instructive. There is no genuine logical contradiction in thermodynamics; the "paradox" is that a natural-looking classical calculation produces an entropy that is non-extensive and predicts irreversibility for a reversible process. The tension forces you to confront a physical question ("what counts as a distinct state for identical particles?") whose answer — indistinguishability — was not part of classical mechanics and had to await quantum theory. So the pedagogical value is real: the paradox is the shortest route to appreciating that particle identity is a physical fact with thermodynamic teeth.