Extensivity and Additivity of Entropy
Cut a cup of coffee in half and you have two half-cups, each with half the entropy of the whole. That sounds trivial, yet it hides one of the deepest structural facts in physics: entropy is extensive, a homogeneous function of degree one in energy, volume, and particle number, . Everything in equilibrium thermodynamics leans on this one property. It is what makes temperature, pressure, and chemical potential well-defined as ratios rather than as size-dependent quantities; it is what makes the Euler relation hold; it is what lets the free energies of independent systems simply add. Statistical mechanics has to earn extensivity from a microscopic count of states, and doing so honestly exposes hidden physics. The primitive notion is additivity: when two subsystems barely interact, their microstate counts multiply, , and Boltzmann's turns that product into a sum. Multiplicativity of counts is equivalent to additivity of entropy — and the logarithm is the only function that performs the conversion. The physical precondition is that forces are short-ranged, so the energy of interaction across a dividing surface scales as area, not volume, and vanishes relative to the bulk as . The historically decisive test is the classical ideal gas. Count distinguishable particles and you get an entropy with a term that refuses to be extensive — the notorious Gibbs paradox, in which removing a partition between two samples of the same gas spuriously raises the entropy. The cure is to admit that identical particles are indistinguishable: divide phase-space volume by and cell size by , and the extensive Sackur–Tetrode entropy emerges. Both fixes are quantum in origin, yet classical thermodynamics forces them on us. Extensivity is not universal, though: gravity and other long-range forces break it outright, and that failure signals genuinely new physics — negative specific heat, ensemble inequivalence, gravothermal collapse.
- Entropy is extensive when (it scales linearly with system size) and additive when a composite's entropy is the sum of its parts, .
- Additivity is equivalent to the multiplicativity of microstate counts, , which holds when subsystems are statistically independent — guaranteed by short-range forces whose cross-surface coupling is subextensive ( of the bulk).
- The distinguishable ideal-gas entropy from is not extensive and gives the Gibbs paradox: naive counting predicts a spurious when two identical -gas halves are combined.
- Dividing by (correct indistinguishability counting) turns into , cancels the paradox exactly, and yields the extensive Sackur–Tetrode entropy, verified against argon to the third figure.
- Extensivity fails for long-range interactions (gravity , unscreened Coulomb), for mesoscopic systems where surface bulk, and near critical points — and thermodynamics built on extensivity must then be rebuilt.
- Key idea: Additivity of entropy () is equivalent to multiplicativity of microstate counts (), which requires statistically independent subsystems — guaranteed by short-range interactions. Extensivity additionally requires correct indistinguishability counting (the factor).
Additivity of entropy () is equivalent to multiplicativity of microstate counts (), which requires statistically independent subsystems — guaranteed by short-range interactions whose cross-surface coupling is subextensive. Extensivity additionally requires correct indistinguishability counting (the factor).
Where this lives today
Extensivity is quietly assumed every time an engineer sizes a chemical reactor or a materials scientist computes the free energy of an alloy — but the frontier is where it breaks. Self-gravitating systems (globular clusters, galaxies) have non-additive entropy, negative microcanonical specific heat, and inequivalent ensembles; the "gravothermal catastrophe" that drives core collapse in star clusters is a direct consequence. The same non-additivity appears in trapped long-range dipolar gases and in mean-field spin models, now studied intensively under the banner of "long-range interacting systems". Sackur–Tetrode remains a live experimental target: modern measurements of the absolute entropy of trapped noble gases, and precision determinations of the Boltzmann constant via acoustic and dielectric gas thermometry, test the same coarse-graining that Sackur and Tetrode introduced in 1912. Every high-entropy alloy — a class of structural materials stabilized by their large configurational mixing entropy — is an application of the distinct-species mixing formula this article derives.
The physical picture
Picture a large box of gas mentally divided into two halves by an imaginary plane. Almost every molecule lives in the bulk and only feels neighbours within a short interaction range; the molecules straddling the plane feel forces across it, but they form a vanishing surface fraction . So to overwhelming accuracy the two halves are statistically independent, their state counts multiply, and the logarithm — the entropy — adds. Extensivity is simply the macroscopic shadow of short-range microscopic forces. The Gibbs paradox is a sanity check the universe insists on passing. If you imagine labelling the two halves of an identical gas and then "mixing" them, nothing physically changes — yet naive labelled counting says the entropy rose by . The fix is to recognise that swapping two identical atoms produces no new microstate: nature counts configurations, not labelled permutations. The is not a fudge factor but the imprint of quantum indistinguishability on classical bookkeeping.
Why the extra factor of ? Classically the phase-space volume is dimensionful, so would carry an arbitrary additive constant per particle. Quantum mechanics quantizes phase space into cells of size — one cell per state, by the uncertainty principle — making a pure number. Both quantum corrections are required together: for the cell size makes entropy absolute (the third law), and for indistinguishability makes it extensive. Neither is optional accounting.
The core equations
Extensivity is the precise mathematical statement that entropy is a first-order homogeneous function. If you double every extensive input at fixed composition, you double the entropy — no more, no less. This is the single equation that the rest of the article must reproduce from microscopics and that occasionally fails in nature.
where: — entropy as a function of the extensive variables; — internal energy, volume, particle number; — an arbitrary scaling factor. Reading it physically: any intensive quantity, being a ratio of two extensive ones, is invariant under this scaling — so temperature and pressure do not care how big the sample is. The microscopic engine of additivity is that independent subsystems have multiplicative state counts. This is where the logarithm in Boltzmann's entropy is not a choice but a necessity — it is the unique operation that converts a product of counts into a sum of entropies.
where: — accessible microstate count of the composite; — counts of the independent subsystems; (exact, SI). Reading it physically: statistical independence ( factorizes) is the same statement as additivity of entropy — the two are logically equivalent. Now the classical ideal gas, counted as if the particles carried name tags. The result contains , and the bare (rather than ) is exactly what wrecks extensivity — scaling and together leaves a stubborn term behind.
where: — particle number; — particle mass; — Planck constant (phase-space cell size); — volume and total kinetic energy. Reading it physically: this is a legitimate count of labelled configurations — but labelled configurations are not distinct physical states for identical atoms, so this entropy over-counts. The repair is a single division. Permuting identical particles yields the same physical microstate, so the labelled count over-counts by exactly .
where: — the number of particle permutations, each producing the identical physical state. Reading it physically: this factor is the entire content of indistinguishability in the classical limit; it is forced not by any measured number but by the demand of extensivity. With the inserted and Stirling applied, becomes and every term now depends on intensive ratios times the prefactor . This is the Sackur–Tetrode equation — the correct, extensive, absolute entropy of a monatomic ideal gas.
where: — volume per particle, the intensive combination that restores extensivity; , the coming from Stirling's . Reading it physically: because makes a pure number, this predicts absolute entropies, not just differences — a prediction confirmed for the noble gases. Extensivity of has an immediate structural payoff. Euler's theorem for homogeneous functions collapses the fundamental relation into a finite, closed form.
where: ; ; . Reading it physically: this Euler relation exists only because is extensive; it is the backbone of the whole apparatus of thermodynamic potentials, and it fails whenever extensivity fails. Finally, when the species are genuinely distinct, mixing does raise the entropy, and the amount is a universal combinatorial formula.
where: — mole fraction of species A; the result is strictly positive for distinct gases and identically zero for identical gases once is included. Reading it physically: the discontinuity between "identical" (zero) and "distinct" (positive) is the sharp experimental signature of indistinguishability.
We show that labelled ("distinguishable") counting predicts a spurious entropy increase on removing a partition between two samples of the same gas, and that the indistinguishability factor cancels it exactly. The setup is two volumes of one ideal gas at the same density and temperature, separated by a partition that is then removed; the physical macrostate is unchanged, so the correct answer must be , and the naive answer's failure to deliver that is precisely the paradox we must dissolve.
Step 1. Take the concrete symmetric case: two halves each holding particles in volume , at equal density . Labelled counting gives each half an entropy containing (equation 3).
Step 2. After the partition is removed, all particles share , so the combined labelled entropy contains . Why this over-counts: labelled counting treats a swap of two identical atoms as a new configuration, which it is not.
Step 3. The naive change is . A strictly positive entropy jump for a process in which nothing physical happened — the Gibbs paradox.
Step 4. Now insert the Gibbs factor: dividing by replaces by everywhere (Stirling: ). Entropy now depends on the density , not on alone.
Step 5. At equal density , so . The same algebra, applied to distinct species whose individual genuinely change, reproduces . Verified: symbolic check confirms naive and, with , at equal density; the distinct-species formula peaks at per particle at (Pathria & Beale §1.5–1.6; Reif §7.3).
Go deeper · Derivation B · 1 minExtensivity from short-range interactions: subextensivity of the surface energy
We demonstrate why short-range forces make the cross-surface interaction energy negligible, so that factorizes and entropy becomes additive. The strategy is to partition a homogeneous -dimensional system of particles into two halves and estimate the interaction energy that couples them across the dividing surface, then compare it to the bulk energy; the whole question of additivity reduces to a scaling comparison of these two numbers as .
Step 1. For short-range forces (interaction range system size ), the bulk energy scales as the number of particles, , while the cross-surface coupling scales as the interface area, .
Step 2. Write the joint partition function , where couples only particles within the interaction range of the surface. Why can be dropped: grows slower than the extensive , so it is a vanishing fraction of the whole.
Step 3. The ratio . In three dimensions this is : for the surface contributes one part in .
Step 4. Hence , so the free energy and the entropy are additive to leading order, . For long-range forces where (every pair couples), this factorization fails and additivity is lost. Verified: numeric check confirms for across –; existence-of-thermodynamic-limit theorems (Ruelle, Lieb) require exactly such tempered short-range potentials (Kardar SPoP ch. 4).
Limiting cases
When does scale linearly with , and when does it break?
| Case | Result | Meaning |
|---|---|---|
| Short-range, thermodynamic limit | Standard regime: potentials decaying faster than in dimensions. Surface energy is subextensive ( of bulk); extensivity and additivity both hold. | |
| Long-range interactions | Gravity (), unscreened Coulomb. Energy is non-additive; ensembles inequivalent; microcanonical negative specific heat appears. Kac rescaling restores a formal extensivity but with non-concave . | |
| Finite / mesoscopic systems | Surface terms are not negligible for small ; strict extensivity is only the leading-order behaviour. | |
| Distinguishable localized modes | (no ) | Oscillators fixed at lattice sites are distinguishable by position; the entropy is already extensive and must not be divided by . |
Worked examples
Example 1 — The Gibbs paradox as a number. Compute the spurious mixing entropy that labelled counting assigns to combining two boxes of identical argon atoms at equal density, and show the correction removes it.
Step 1. Labelled entropy of each half contains ; combined system contains (all atoms share ).
Step 2. Naive change: . For one mole, and of entropy conjured from nothing.
Step 3. With , entropy depends on only. At equal density , so . The naive answer is per mole of spurious entropy; the correct answer with indistinguishability is . The gap is precisely the Gibbs paradox.
Example 2 — Absolute entropy of argon from Sackur–Tetrode. Evaluate the Sackur–Tetrode molar entropy of argon at standard conditions and compare with the measured value . Argon: , , .
Step 1. Thermal de Broglie wavelength .
Step 2. Volume per particle from the ideal-gas law: .
Step 3. The dimensionless log-argument is . Why : the momentum-space factor equals for an ideal gas with .
Step 4. So , and per mole . The Sackur–Tetrode prediction is , matching the experimental standard molar entropy of argon to the third figure — a quantitative confirmation that the cell and factor are physically real, not bookkeeping conveniences.
History band
Origins · 1 minJosiah Willard Gibbs and how this was discovered
Going further
References. Pathria & Beale, Statistical Mechanics, 3rd ed., §1.5–1.6 (Gibbs paradox, Sackur–Tetrode) · Kardar, Statistical Physics of Particles, ch. 4 · Reif, Fundamentals of Statistical and Thermal Physics, §7.3 and §2.5 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, ch. 3 · Landau & Lifshitz, Statistical Physics Part 1, §7, §24 · Campa, Dauxois, Ruffo, Physics Reports 480 (2009) 57 — long-range interactions and non-additivity.
Provenance. All equations are standard textbook results; Sackur–Tetrode and the Gibbs paradox follow Pathria & Beale §1.5–1.6 and Reif §7.3, and the short-range condition for the thermodynamic limit follows Kardar SPoP ch. 4 (Ruelle/Lieb). Numerical check: standard molar entropy of argon (NIST/CODATA); , . A verifier should recompute , at STP, the Sackur–Tetrode value, the mixing-entropy formula, and the surface-to-bulk scaling. Base-migration note: the source draft mislabelled the argon intermediates (-argument , ); the correct chain is -argument , , giving the same final — corrected here and reflected in the worked example and cheat sheet.
Builds on: Boltzmann Entropy · Accessible Phase Space and Energy Shells · Microstates and Macrostates · Phase Space Leads to: Statistical Ensembles · Gibbs Entropy · Equal A Priori Probabilities
Additive and extensive sound like the same thing — are they?
They are closely related but not identical. Additive means the entropy of a composite equals the sum of its parts, ; it is a statement about combining independent systems. Extensive means is a homogeneous function of degree one, ; it is additivity applied recursively to identical replicas. Additivity requires only short-range interactions (so counts factorize); extensivity requires additivity plus correct indistinguishability counting (the ), because without it even a single homogeneous gas fails to scale linearly.
Where does the factor of 5/2 in Sackur–Tetrode actually come from?
Two pieces add up. The is the momentum-space (kinetic) contribution: integrating over the -dimensional momentum ball on the energy shell gives an factor, hence per particle after taking the log and dividing by . The extra comes from Stirling's approximation to : , and the (i.e. per particle after the sign flips through ) lifts to . So the literally encodes both the kinetic degrees of freedom and the indistinguishability correction.
If I mix two gases that differ only by isotope, is the mixing entropy zero or positive?
Positive. Different isotopes are genuinely distinct species — they have different masses and are, in principle, distinguishable — so each expands into the full volume and its own changes, giving . This is not a technicality: it is why isotope separation costs free energy (you must pay back the mixing entropy to un-mix), and it is the thermodynamic basis of enrichment. Only truly identical particles — same isotope, same internal state — give zero mixing entropy.
Why does gravity break extensivity when electromagnetism does not?
Both are forces, but electromagnetic charges come in two signs and screen: in any neutral plasma the effective interaction is cut off beyond the Debye length, making it effectively short-range, so entropy is extensive. Gravity has only one sign (mass is always attractive), so there is no screening; the interaction energy of masses grows as and the entropy as . That superextensivity is why self-gravitating systems have non-additive entropy, negative specific heat, and inequivalent ensembles — genuinely different thermodynamics.
Does the mean classical particles are "secretly quantum"?
In a sense, yes — and that is the striking part. Purely classical statistical mechanics cannot justify the on its own; it is imposed only because extensivity demands it. Quantum mechanics explains it: identical particles are described by (anti)symmetrized wavefunctions in which permutations are not distinct states, so indistinguishability is built in from the start. The classical is the shadow this quantum fact casts on the classical count. Likewise the cell size is the shadow of phase-space quantization. Both are quantum corrections that classical thermodynamics could not derive but could not do without.
Is the entropy of a small nanoparticle extensive?
Not strictly. For a finite system the entropy carries surface corrections, , where the term counts atoms on the surface. For this term is one part in and utterly negligible, but for a nanoparticle of a few thousand atoms it is a percent-level correction that matters for melting-point depression, catalytic activity, and thermodynamic stability. Extensivity is an asymptotic () statement; treat it with care in the mesoscopic world.
Could I define entropy without the logarithm and keep additivity?
No, and this is the deep reason the logarithm is not arbitrary. Additivity demands a function with — that is, must turn products into sums. The only continuous solution is for some constant . Any other choice (say itself, or ) fails to be additive for independent subsystems. So the moment you insist entropy add when you combine independent systems, Boltzmann's is forced on you up to the units-fixing constant .