Entropy of Mixing and the Gibbs Paradox
Open the valve between two chambers — one full of nitrogen, one full of oxygen, both at the same temperature and pressure — and something irreversible happens: the gases interdiffuse, the entropy of the universe rises, and no gentle nudge will ever un-mix them. That entropy increase, , is one of the cleanest quantitative statements in thermodynamics. Each gas expands to fill the whole volume, its entropy rising by exactly the isothermal-expansion amount, and the total is set purely by the mole fractions. Now repeat the experiment with the same gas on both sides — nitrogen and nitrogen. Nothing thermodynamic happens when you open the valve: the entropy does not change. Yet the naive calculation, treating the molecules as distinguishable, predicts the same as for two different gases. That is the Gibbs paradox: a formula that gives a spurious, discontinuous jump of for a 50/50 mixture of identical gases where physically there should be nothing at all. Gibbs spotted this in 1875 and saw that it was not a small anomaly but a signpost pointing at something deep. The resolution is that identical particles are genuinely indistinguishable — swapping two of them does not produce a new microstate — so the count of states must be divided by (the Gibbs correction). With the in place, the entropy becomes properly extensive (the Sackur–Tetrode form), and mixing identical gases gives exactly zero. This article computes the mixing entropy for distinct gases, exhibits the paradoxical discontinuity for identical ones, and shows how the — ultimately a quantum-mechanical fact about identical particles — removes it. The Gibbs paradox is where classical thermodynamics quietly demands quantum indistinguishability.
- Mixing two distinct ideal gases at equal raises the entropy by ; for a 50/50 mix this is (per total : ).
- Mixing two identical gases changes nothing — but the naive distinguishable count predicts the same jump: the Gibbs paradox.
- The paradox is a discontinuity: leaps from (distinguishable) to (identical) with no smooth interpolation.
- The Gibbs correction, from the indistinguishability of identical particles, makes the entropy extensive (Sackur–Tetrode) and gives for identical gases.
- Indistinguishability is fundamentally a quantum fact; the Gibbs paradox is where classical thermodynamics silently requires it.
- Key idea: the entropy of mixing is real for distinct gases and exactly zero for identical ones; the discontinuity between them is resolved only by the indistinguishability factor.
The entropy of mixing is , positive for distinct gases and exactly zero for identical gases. The Gibbs paradox is the spurious discontinuous jump that the distinguishable count predicts for identical gases; the indistinguishability correction — a quantum fact — restores extensivity and removes the paradox.
Where this lives today
The entropy of mixing is the thermodynamic engine behind separation science and much of chemistry. Every distillation column, every gas-separation membrane, every isotope-enrichment cascade is fighting the mixing entropy: because un-mixing lowers entropy, it costs at least of work, and this sets the fundamental thermodynamic minimum energy for purifying a substance. The outsized per-molecule entropy of trace components is exactly why enriching uranium or separating deuterium is so energy-intensive — the minority species is deep in the logarithm. The Gibbs paradox itself remains a live conceptual touchstone. It is the cleanest classical argument that identical particles must be treated as indistinguishable, a fact that quantum mechanics later grounds in the symmetry of the many-body wavefunction — the same indistinguishability that produces Bose–Einstein condensation, Fermi degeneracy pressure, and the Pauli exclusion principle. In information theory the mixing entropy reappears as the Shannon entropy of a mixture, and in the thermodynamics of computation (Landauer's principle, Maxwell's demon) the reversibility of mixing/un-mixing identical versus distinct particles is central to understanding the physical cost of information. Gibbs's little paradox turned out to be a doorway into three subjects at once.
The physical picture
The entropy of mixing is, at heart, two independent free expansions. When gas A (originally in volume ) is allowed to occupy the combined volume , its entropy rises by — the same increase as any isothermal expansion to twice the volume, because there are now twice as many places to put each molecule. Gas B does the same. Since the two gases are different, both expansions are real and independent, and the total is . The point is not that the gases "mix" in some special way; it is that each species, seen alone, has doubled its accessible volume.
Here the paradox announces itself. If the two "gases" are actually the same substance, opening the valve produces no observable change — you cannot even tell that the valve was opened. Push each half back to its original chamber and you have restored the exact original state, reversibly, with no work and no heat. So the entropy change must be zero. But the free-expansion bookkeeping does not know the gases are identical; it happily counts for each half doubling its volume. The classical formula, taking particles as distinguishable, gives a nonzero answer for a nothing-happened process. The resolution is a discontinuity that no continuous deformation can bridge. Imagine tuning a parameter that makes two species "gradually" more similar — a heavier isotope, a slightly different color. As long as they are distinguishable at all, opening the valve is irreversible and , no matter how tiny the difference. The instant they become truly identical, drops to . There is a step, not a ramp. The punchline plot below shows this cliff — and shows that the distinguishable count (dashed) never reaches zero, which is exactly the paradox the correction fixes.
The core equations
The mixing entropy for an arbitrary number of distinct ideal-gas species follows from adding the independent expansions. With total particle number and mole fractions :
where: — mole fraction of species ; — Boltzmann constant. Each term is the isothermal-expansion entropy of species growing from its partial volume into the whole. The result is always positive (mixing is irreversible). For the symmetric two-gas case (, so total , ), Equation (1) gives the number to remember:
where: — total number of molecules; the factor is the doubling of each species' accessible volume. Per total particle this is ; expressed with particles of each gas it is . Now the paradox: for identical gases treated with a distinguishable (no ) count, the entropy is not extensive. The naive entropy has the form , and combining two boxes gives a spurious surplus:
where: the culprit is the (rather than ) — a non-extensive entropy that gains upon merging identical boxes. Physically this must be zero, so the naive count is wrong. The Gibbs correction divides the number of microstates by , turning into and producing the extensive Sackur–Tetrode entropy:
where: — thermal de Broglie wavelength; the (volume per particle) rather than is exactly what the supplies via Stirling, . With this form, exactly, so mixing identical gases gives .
The goal is to compute directly from the entropy change of each gas, showing that distinct gases give while identical gases give exactly zero once the correct extensive entropy is used. The strategy is to treat the mixing of two ideal gases as two simultaneous isothermal expansions and to compute the "before" and "after" entropies from the Sackur–Tetrode form.
Step 1. Distinct gases. Gas 1 ( molecules) starts in volume and ends in ; its entropy rises by . Gas 2 likewise gains . At equal initial density and temperature, , so . Why: an ideal gas expanding isothermally from to gains entropy — a standard result, and the two gases do this independently because they do not interact.
Step 2. Add them: . Generalizing to many species gives Equation (1). Why: each logarithm is positive since , so the total mixing entropy is positive — mixing is irreversible.
Step 3. Identical gases, naive count. Using (no ), compute merging two boxes of into : . This is nonzero — the paradox. Why: the offending term is ; doubling the volume of the merged box against the sum of the separate ones leaves a leftover per particle that has no physical basis when the gases are the same.
Step 4. Identical gases, correct count. Using the extensive Sackur–Tetrode form (with the built in), the same merge gives , because . Why: the replaces by (volume per particle), which is unchanged when both and double — so the merged and separated states have identical entropy and mixing does nothing. *Verified: symbolic computation gives , (spurious), and with the extensive Sackur–Tetrode form, in verify_aq-sm-entropy-mixing-gibbs-paradox.py.*
Go deeper · Derivation B · 2 minThe discontinuity is unavoidable classically — the owned structural result
Limiting cases
The mixing entropy behaves informatively at its boundaries:
| Case | Result | Meaning |
|---|---|---|
| Equal 50/50 mix | Maximum mixing entropy for two distinct species. | |
| Trace impurity () | A little impurity gains a lot of entropy per molecule (large volume ratio). | |
| Identical gases | No paradox with the correction; the merged state is the same state. | |
| Naive (distinguishable) count | even for identical | The Gibbs paradox: non-extensive entropy, physically wrong. |
| Multi-species | Total mixing entropy is the Shannon entropy of the composition. |
Worked examples
1 · The mixing entropy of air, molecule by molecule (a real number)
Model dry air as N and O and Ar (ignore trace gases; renormalize to ). Compute the molar entropy of mixing that would be released if you could un-mix one mole of air into its pure components.
Step 1. Use per mole ( for one mole). Enumerate the three terms.
Step 2. Compute each: ; ; .
Step 3. Sum: . Multiply by : .
Step 4. Interpret the boundary. The tiny argon fraction () contributes — nearly of the total — because each argon molecule expands into a hundred times its partial volume (). A minority species carries outsized mixing entropy per molecule; this is why separating trace gases (or isotopes) is thermodynamically expensive.
2 · Identical versus isotopically-labeled gas (exam level)
Two chambers each hold molecules of nitrogen at equal . (a) If both are ordinary N, what is on opening the valve? (b) If one chamber holds N and the other N (a distinguishable isotope), what is ? (c) What does the naive distinguishable count give in case (a)?
Step 1. Case (a), identical: opening the valve produces no observable change, and with the extensive (Sackur–Tetrode, ) entropy the merged state equals the separated one. .
Step 2. Case (b), distinct isotopes: even though N and N are chemically identical, they are physically distinguishable (different mass, separable by a mass spectrometer). So this is genuine two-species mixing: , i.e. per mole .
Step 3. The jump. The isotopic mass difference is one part in fourteen, yet the entropy leaps from to the full — the discontinuity. Any distinguishing feature, however small, triggers the entire mixing entropy.
Step 4. Case (c), naive count for identical gas: — the same as the distinct case, which is wrong. It fails because the labeled count does not divide by ; this spurious nonzero answer is the Gibbs paradox, and the correction removes it, restoring .
Origins · 1 minentropy of mixing and how this was discovered
The entropy of mixing measures the irreversibility of combining distinct substances, and its history is inseparable from the paradox that carries Gibbs's name. Gibbs, in On the Equilibrium of Heterogeneous Substances (1875–78), noticed that the mixing-entropy formula gives the same answer whether two gases are slightly different or wildly different — yet drops abruptly to zero when they become identical. He recognized this discontinuity as physically correct and traced its resolution to the indistinguishability of identical molecules, decades before quantum mechanics gave indistinguishability its rigorous meaning through wavefunction symmetry. The quantity is mathematically the Shannon/Boltzmann entropy of the composition distribution — the same that measures information — which is why the mixing entropy equals the information you gain by learning the identity of a randomly drawn molecule. It remains a touchstone example that classical thermodynamics already encodes quantum facts.
Going further
References. Pathria & Beale, Statistical Mechanics, 3rd ed., §1.5–1.6 (Gibbs paradox and Sackur–Tetrode) · Kardar, Statistical Physics of Particles, §4.9 · Reif, Fundamentals of Statistical and Thermal Physics, §7.3 · Sethna, Statistical Mechanics, §5.2 and Ch. 3 · Landau & Lifshitz, Statistical Physics Part 1, §40 · Jaynes, "The Gibbs Paradox" (1992) for the information-theoretic view.
Provenance. The mixing-entropy formula and its resolution are standard (Pathria §1.5–1.6; Kardar §4.9; Reif §7.3). A verifier should reproduce: (and for 50/50); the identical case using the extensive Sackur–Tetrode entropy; and the spurious from the naive (no ) count. Numerical instances (air ; isotope mix ) are recomputed in verify_aq-sm-entropy-mixing-gibbs-paradox.py. (CODATA).
Builds on: Second Law of Thermodynamics and Entropy · Reversible and Irreversible Processes · Thermodynamic Potentials and the Fundamental Relation · Euler Relation and Gibbs–Duhem Equation. Leads to: Helmholtz Free Energy, Enthalpy, and Gibbs Free Energy · Third Law of Thermodynamics · Maxwell Relations · Indistinguishability and Identical Particles.
Why does mixing two different gases increase entropy but mixing two portions of the same gas does not?
Because entropy counts distinguishable arrangements. When two different gases mix, each species gains access to twice the volume, and there are genuinely more distinguishable microstates — you could, in principle, measure that a nitrogen molecule is now on the side where only oxygen used to be. That extra freedom is real entropy, for a 50/50 split. When two portions of the same gas "mix," nothing new becomes distinguishable: a nitrogen molecule on the left is interchangeable with one on the right, so opening the valve does not create any new arrangements you could tell apart. The number of distinguishable microstates is unchanged, so the entropy is unchanged. The whole difference is whether the swap of a left molecule for a right one produces a new state (distinct gases) or the same state (identical gas).
Is the 1/N! factor exact, or just an approximation valid at high temperature?
The classical is exact as a counting correction — it removes precisely the ways of permuting identical labels, which classical phase space overcounts. What is approximate is the replacement of the true quantum count by : that holds in the non-degenerate (dilute, high-temperature) regime where the thermal wavelength is much smaller than the interparticle spacing, so at most one particle occupies each single-particle state and the distinction between bosons and fermions does not matter. When the gas becomes degenerate (low , high density), the is no longer enough — you need the full Bose–Einstein or Fermi–Dirac counting. So for the Gibbs paradox at ordinary conditions the is the right and exact fix; it is only its derivation as a limit of quantum statistics that is a high-temperature approximation.
If two gases differ only infinitesimally, why isn't the mixing entropy infinitesimal too?
This is the heart of the paradox, and the answer is that distinguishability is binary, not continuous. Entropy counts states you can tell apart, and "can you tell them apart?" has only two answers: yes or no. If two gases differ by any measurable amount — a different mass, a different spectral line, anything — then in principle you can build an apparatus that separates them, so the mixing is irreversible and carries the full . If they are truly identical, no such apparatus can exist and the entropy is zero. There is no "half-distinguishable." So the mixing entropy is a step function of similarity, not a ramp. What does scale with the difference is the practical difficulty and energy cost of un-mixing, but the thermodynamic entropy is all-or-nothing.
Does the Gibbs paradox prove that classical mechanics is wrong?
Not exactly — it shows that classical mechanics is incomplete about identical particles. Classical mechanics labels particles by their trajectories, so it always treats them as distinguishable and can never represent true identity; that is why the naive classical count gives the paradoxical nonzero mixing entropy for identical gases. The correction patches this by hand, and it gives the right thermodynamics, but it has no justification within classical mechanics — you have to put it in because you know the particles are identical. The deep resolution comes from quantum mechanics, where identical particles are described by (anti)symmetrized wavefunctions and indistinguishability is built into the formalism from the start. So the paradox is a place where classical thermodynamics, correctly done, silently requires a quantum input — a striking early hint that the microscopic world is not classical.
Why does a trace impurity contribute so much mixing entropy per molecule?
Because the mixing entropy per molecule of species is , which grows as the fraction shrinks. A trace component starts confined to a tiny partial volume and then expands into essentially the whole container, and the entropy of expansion is the logarithm of the volume ratio, which is large for a small starting fraction. For a component, each molecule expands into its partial volume, contributing — far more per molecule than a majority species. This is why the total mixing entropy has a substantial contribution from minor components, and it is the thermodynamic reason that separating dilute impurities or enriching rare isotopes requires disproportionately large amounts of work.
Is the entropy of mixing the same thing as the Shannon entropy of information theory?
Mathematically, yes — up to the constant . The mixing entropy is exactly times the Shannon entropy of the composition distribution . It measures the average information (in nats, or bits if you use ) you gain by learning the identity of a randomly chosen molecule from the mixture. This is not a coincidence: Boltzmann–Gibbs entropy and Shannon entropy are the same functional, and the mixing problem is a clean physical instance where thermodynamic entropy is missing information about composition. Jaynes emphasized this view, arguing that the Gibbs paradox dissolves once you recognize that entropy is defined relative to the macroscopic variables you choose to distinguish — if you cannot (or do not) tell two species apart, there is no mixing entropy, exactly as for identical gases.