Extensivity and Additivity of Entropy

Cut a cup of coffee in half and you have two half-cups, each with half the entropy of the whole. That sounds trivial, yet it hides one of the deepest structural facts in physics: entropy is extensive, a homogeneous function of degree one in energy, volume, and particle number, S(λE,λV,λN)=λS(E,V,N)S(\lambda E,\lambda V,\lambda N)=\lambda S(E,V,N). Everything in equilibrium thermodynamics leans on this one property. It is what makes temperature, pressure, and chemical potential well-defined as ratios rather than as size-dependent quantities; it is what makes the Euler relation E=TS−pV+μNE=TS-pV+\mu N hold; it is what lets the free energies of independent systems simply add. Statistical mechanics has to earn extensivity from a microscopic count of states, and doing so honestly exposes hidden physics. The primitive notion is additivity: when two subsystems barely interact, their microstate counts multiply, Ω=Ω1Ω2\Omega=\Omega_1\Omega_2, and Boltzmann's S=kBln⁡ΩS=k_{\mathrm B}\ln\Omega turns that product into a sum. Multiplicativity of counts is equivalent to additivity of entropy — and the logarithm is the only function that performs the conversion. The physical precondition is that forces are short-ranged, so the energy of interaction across a dividing surface scales as area, not volume, and vanishes relative to the bulk as N→∞N\to\infty. The historically decisive test is the classical ideal gas. Count distinguishable particles and you get an entropy with a NkBln⁡VNk_{\mathrm B}\ln V term that refuses to be extensive — the notorious Gibbs paradox, in which removing a partition between two samples of the same gas spuriously raises the entropy. The cure is to admit that identical particles are indistinguishable: divide phase-space volume by N!N! and cell size by h3Nh^{3N}, and the extensive Sackur–Tetrode entropy emerges. Both fixes are quantum in origin, yet classical thermodynamics forces them on us. Extensivity is not universal, though: gravity and other long-range forces break it outright, and that failure signals genuinely new physics — negative specific heat, ensemble inequivalence, gravothermal collapse.

Key takeaways
  • Entropy is extensive when S(λE,λV,λN)=λS(E,V,N)S(\lambda E,\lambda V,\lambda N)=\lambda S(E,V,N) (it scales linearly with system size) and additive when a composite's entropy is the sum of its parts, S=S1+S2S=S_1+S_2.
  • Additivity is equivalent to the multiplicativity of microstate counts, Ω=Ω1Ω2\Omega=\Omega_1\Omega_2, which holds when subsystems are statistically independent — guaranteed by short-range forces whose cross-surface coupling is subextensive (∼N−1/d\sim N^{-1/d} of the bulk).
  • The distinguishable ideal-gas entropy from Ω∝VN\Omega\propto V^N is not extensive and gives the Gibbs paradox: naive counting predicts a spurious ΔS=2NkBln⁡2\Delta S=2Nk_{\mathrm B}\ln 2 when two identical NN-gas halves are combined.
  • Dividing by N!N! (correct indistinguishability counting) turns ln⁡V\ln V into ln⁡(V/N)\ln(V/N), cancels the paradox exactly, and yields the extensive Sackur–Tetrode entropy, verified against argon to the third figure.
  • Extensivity fails for long-range interactions (gravity ∼N5/3\sim N^{5/3}, unscreened Coulomb), for mesoscopic systems where surface ∼\sim bulk, and near critical points — and thermodynamics built on extensivity must then be rebuilt.
  • Key idea: Additivity of entropy (S=S1+S2S=S_1+S_2) is equivalent to multiplicativity of microstate counts (Ω=Ω1Ω2\Omega=\Omega_1\Omega_2), which requires statistically independent subsystems — guaranteed by short-range interactions. Extensivity additionally requires correct indistinguishability counting (the 1/N!1/N! factor).
The core insight

Additivity of entropy (S=S1+S2S=S_1+S_2) is equivalent to multiplicativity of microstate counts (Ω=Ω1Ω2\Omega=\Omega_1\Omega_2), which requires statistically independent subsystems — guaranteed by short-range interactions whose cross-surface coupling is subextensive. Extensivity additionally requires correct indistinguishability counting (the 1/N!1/N! factor).

Where this lives today

Extensivity is quietly assumed every time an engineer sizes a chemical reactor or a materials scientist computes the free energy of an alloy — but the frontier is where it breaks. Self-gravitating systems (globular clusters, galaxies) have non-additive entropy, negative microcanonical specific heat, and inequivalent ensembles; the "gravothermal catastrophe" that drives core collapse in star clusters is a direct consequence. The same non-additivity appears in trapped long-range dipolar gases and in mean-field spin models, now studied intensively under the banner of "long-range interacting systems". Sackur–Tetrode remains a live experimental target: modern measurements of the absolute entropy of trapped noble gases, and precision determinations of the Boltzmann constant via acoustic and dielectric gas thermometry, test the same h3h^3 coarse-graining that Sackur and Tetrode introduced in 1912. Every high-entropy alloy — a class of structural materials stabilized by their large configurational mixing entropy −NkB∑xiln⁡xi-Nk_{\mathrm B}\sum x_i\ln x_i — is an application of the distinct-species mixing formula this article derives.

The physical picture

Picture a large box of gas mentally divided into two halves by an imaginary plane. Almost every molecule lives in the bulk and only feels neighbours within a short interaction range; the molecules straddling the plane feel forces across it, but they form a vanishing surface fraction ∼N2/3/N=N−1/3→0\sim N^{2/3}/N=N^{-1/3}\to0. So to overwhelming accuracy the two halves are statistically independent, their state counts multiply, and the logarithm — the entropy — adds. Extensivity is simply the macroscopic shadow of short-range microscopic forces. The Gibbs paradox is a sanity check the universe insists on passing. If you imagine labelling the two halves of an identical gas and then "mixing" them, nothing physically changes — yet naive labelled counting says the entropy rose by 2NkBln⁡22Nk_{\mathrm B}\ln 2. The fix is to recognise that swapping two identical atoms produces no new microstate: nature counts configurations, not labelled permutations. The 1/N!1/N! is not a fudge factor but the imprint of quantum indistinguishability on classical bookkeeping.

Figure
Short-range forces make entropy additive — long-range forces do not
Short-range (gas) Long-range (gravity) only surface pairs couple: E_surf ∼ N^(2/3) Ω = Ω₁·Ω₂ ⇒ S = S₁ + S₂ every pair couples: E_int ∼ N² Ω ≠ Ω₁·Ω₂ ⇒ S non-additive S ∼ N^(5/3): superextensive

Why the extra factor of h3Nh^{3N}? Classically the phase-space volume is dimensionful, so ln⁡Ω\ln\Omega would carry an arbitrary additive constant per particle. Quantum mechanics quantizes phase space into cells of size h3Nh^{3N} — one cell per state, by the uncertainty principle — making Ω\Omega a pure number. Both quantum corrections are required together: hh for the cell size makes entropy absolute (the third law), and N!N! for indistinguishability makes it extensive. Neither is optional accounting.

Figure
The Gibbs paradox and its cure: mixing two identical N-gas halves
Remove partition between two identical gases at equal density N, V_h N, V_h → 2N, 2V_h (same density) ΔS naive (labelled): ΔS = 2Nk ln2 > 0 ✗ paradox with 1/N! : ΔS = 0 ✓ correct the 1/N! factor turns ln V into ln(V/N); at equal density all V/N are equal, so ΔS cancels

The core equations

Extensivity is the precise mathematical statement that entropy is a first-order homogeneous function. If you double every extensive input at fixed composition, you double the entropy — no more, no less. This is the single equation that the rest of the article must reproduce from microscopics and that occasionally fails in nature.

S(λE,λV,λN)=λ S(E,V,N)(1)S(\lambda E,\lambda V,\lambda N)=\lambda\,S(E,V,N) \qquad (1)

where: SS — entropy as a function of the extensive variables; E,V,NE,V,N — internal energy, volume, particle number; λ>0\lambda>0 — an arbitrary scaling factor. Reading it physically: any intensive quantity, being a ratio of two extensive ones, is invariant under this scaling — so temperature and pressure do not care how big the sample is. The microscopic engine of additivity is that independent subsystems have multiplicative state counts. This is where the logarithm in Boltzmann's entropy is not a choice but a necessity — it is the unique operation that converts a product of counts into a sum of entropies.

Ω=Ω1 Ω2  ⟹  S=kBln⁡Ω=S1+S2(2)\Omega = \Omega_1\,\Omega_2 \;\Longrightarrow\; S = k_{\mathrm B}\ln\Omega = S_1 + S_2 \qquad (2)

where: Ω\Omega — accessible microstate count of the composite; Ω1,2\Omega_{1,2} — counts of the independent subsystems; kB=1.380649×10−23 J K−1k_{\mathrm B}=1.380649\times10^{-23}\,\mathrm{J\,K^{-1}} (exact, SI). Reading it physically: statistical independence (Ω\Omega factorizes) is the same statement as additivity of entropy — the two are logically equivalent. Now the classical ideal gas, counted as if the particles carried name tags. The result contains NkBln⁡VNk_{\mathrm B}\ln V, and the bare ln⁡V\ln V (rather than ln⁡(V/N)\ln(V/N)) is exactly what wrecks extensivity — scaling VV and NN together leaves a stubborn λln⁡λ\lambda\ln\lambda term behind.

Sdist=NkB[ln⁡ ⁣(V(4πmE3Nh2)3/2)+32](3)S_{\text{dist}} = N k_{\mathrm B}\left[\ln\!\left(V\left(\tfrac{4\pi mE}{3Nh^2}\right)^{3/2}\right)+\tfrac{3}{2}\right] \qquad (3)

where: NN — particle number; mm — particle mass; hh — Planck constant (phase-space cell size); V,EV,E — volume and total kinetic energy. Reading it physically: this is a legitimate count of labelled configurations — but labelled configurations are not distinct physical states for identical atoms, so this entropy over-counts. The repair is a single division. Permuting NN identical particles yields the same physical microstate, so the labelled count over-counts by exactly N!N!.

Ωindist=1N! Ωdist(4)\Omega_{\text{indist}}=\frac{1}{N!}\,\Omega_{\text{dist}} \qquad (4)

where: N!N! — the number of particle permutations, each producing the identical physical state. Reading it physically: this factor is the entire content of indistinguishability in the classical limit; it is forced not by any measured number but by the demand of extensivity. With the 1/N!1/N! inserted and Stirling applied, ln⁡V\ln V becomes ln⁡(V/N)\ln(V/N) and every term now depends on intensive ratios times the prefactor NN. This is the Sackur–Tetrode equation — the correct, extensive, absolute entropy of a monatomic ideal gas.

S=NkB[ln⁡ ⁣(VN(4πmE3Nh2)3/2)+52](5)S = N k_{\mathrm B}\left[\ln\!\left(\frac{V}{N}\left(\frac{4\pi mE}{3Nh^2}\right)^{3/2}\right)+\frac{5}{2}\right] \qquad (5)

where: V/NV/N — volume per particle, the intensive combination that restores extensivity; 52=32+1\tfrac{5}{2}=\tfrac{3}{2}+1, the +1+1 coming from Stirling's ln⁡N!≈Nln⁡N−N\ln N!\approx N\ln N-N. Reading it physically: because hh makes Ω\Omega a pure number, this predicts absolute entropies, not just differences — a prediction confirmed for the noble gases. Extensivity of E(S,V,N)E(S,V,N) has an immediate structural payoff. Euler's theorem for homogeneous functions collapses the fundamental relation into a finite, closed form.

E=TS−pV+μN(6)E = TS - pV + \mu N \qquad (6)

where: T=(∂E/∂S)V,NT=(\partial E/\partial S)_{V,N}; p=−(∂E/∂V)S,Np=-(\partial E/\partial V)_{S,N}; μ=(∂E/∂N)S,V\mu=(\partial E/\partial N)_{S,V}. Reading it physically: this Euler relation exists only because EE is extensive; it is the backbone of the whole apparatus of thermodynamic potentials, and it fails whenever extensivity fails. Finally, when the species are genuinely distinct, mixing does raise the entropy, and the amount is a universal combinatorial formula.

ΔSmix=−NkB(xln⁡x+(1−x)ln⁡(1−x))(7)\Delta S_{\text{mix}} = -N k_{\mathrm B}\big(x\ln x + (1-x)\ln(1-x)\big) \qquad (7)

where: xx — mole fraction of species A; the result is strictly positive for distinct gases and identically zero for identical gases once 1/N!1/N! is included. Reading it physically: the discontinuity between "identical" (zero) and "distinct" (positive) is the sharp experimental signature of indistinguishability.

Derivation AResolving the Gibbs paradox: mixing identical gases

We show that labelled ("distinguishable") counting predicts a spurious entropy increase on removing a partition between two samples of the same gas, and that the indistinguishability factor 1/N!1/N! cancels it exactly. The setup is two volumes of one ideal gas at the same density and temperature, separated by a partition that is then removed; the physical macrostate is unchanged, so the correct answer must be ΔS=0\Delta S=0, and the naive answer's failure to deliver that is precisely the paradox we must dissolve.

Step 1. Take the concrete symmetric case: two halves each holding NN particles in volume VhV_h, at equal density n=N/Vhn=N/V_h. Labelled counting gives each half an entropy containing NkBln⁡VhNk_{\mathrm B}\ln V_h (equation 3).

Step 2. After the partition is removed, all 2N2N particles share 2Vh2V_h, so the combined labelled entropy contains 2NkBln⁡(2Vh)2Nk_{\mathrm B}\ln(2V_h). Why this over-counts: labelled counting treats a swap of two identical atoms as a new configuration, which it is not.

Step 3. The naive change is ΔS=kB[2Nln⁡(2Vh)−Nln⁡Vh−Nln⁡Vh]=2NkBln⁡2>0\Delta S = k_{\mathrm B}\big[2N\ln(2V_h) - N\ln V_h - N\ln V_h\big] = 2Nk_{\mathrm B}\ln 2 > 0. A strictly positive entropy jump for a process in which nothing physical happened — the Gibbs paradox.

Step 4. Now insert the Gibbs factor: dividing Ω\Omega by N!N! replaces ln⁡V\ln V by ln⁡(V/N)\ln(V/N) everywhere (Stirling: ln⁡VN/N!→Nln⁡(V/N)+N\ln V^N/N!\to N\ln(V/N)+N). Entropy now depends on the density V/NV/N, not on VV alone.

Step 5. At equal density Vh/N=(2Vh)/(2N)=1/nV_h/N=(2V_h)/(2N)=1/n, so ΔS=kB[2Nln⁡2Vh2N−Nln⁡VhN−Nln⁡VhN]=0\Delta S = k_{\mathrm B}\big[2N\ln\tfrac{2V_h}{2N} - N\ln\tfrac{V_h}{N} - N\ln\tfrac{V_h}{N}\big]=0. The same algebra, applied to distinct species whose individual V/NiV/N_i genuinely change, reproduces ΔSmix=−NkB∑ixiln⁡xi>0\Delta S_{\text{mix}}=-Nk_{\mathrm B}\sum_i x_i\ln x_i>0. Verified: symbolic check confirms naive ΔS=2NkBln⁡2\Delta S=2Nk_{\mathrm B}\ln2 and, with 1/N!1/N!, ΔS=0\Delta S=0 at equal density; the distinct-species formula peaks at ln⁡2\ln2 per particle at x=12x=\tfrac12 (Pathria & Beale §1.5–1.6; Reif §7.3).

Go deeper · Derivation B · 1 minExtensivity from short-range interactions: subextensivity of the surface energy
Derivation BExtensivity from short-range interactions: subextensivity of the surface energy

We demonstrate why short-range forces make the cross-surface interaction energy negligible, so that Ω\Omega factorizes and entropy becomes additive. The strategy is to partition a homogeneous dd-dimensional system of NN particles into two halves and estimate the interaction energy that couples them across the dividing surface, then compare it to the bulk energy; the whole question of additivity reduces to a scaling comparison of these two numbers as N→∞N\to\infty.

Step 1. For short-range forces (interaction range ≪\ll system size LL), the bulk energy scales as the number of particles, Ebulk∼NE_{\text{bulk}}\sim N, while the cross-surface coupling scales as the interface area, Esurface∼Ld−1∼N(d−1)/dE_{\text{surface}}\sim L^{d-1}\sim N^{(d-1)/d}.

Step 2. Write the joint partition function Z=Tr e−β(H1+H2+H12)Z=\mathrm{Tr}\,e^{-\beta(H_1+H_2+H_{12})}, where H12H_{12} couples only particles within the interaction range of the surface. Why H12H_{12} can be dropped: β⟨H12⟩∼N(d−1)/d\beta\langle H_{12}\rangle\sim N^{(d-1)/d} grows slower than the extensive β⟨H⟩∼N\beta\langle H\rangle\sim N, so it is a vanishing fraction of the whole.

Step 3. The ratio Esurface/Ebulk∼N(d−1)/d/N=N−1/d→0E_{\text{surface}}/E_{\text{bulk}}\sim N^{(d-1)/d}/N = N^{-1/d}\to0. In three dimensions this is N−1/3N^{-1/3}: for N∼1024N\sim10^{24} the surface contributes one part in 10810^{8}.

Step 4. Hence ln⁡Z=ln⁡Z1+ln⁡Z2+O(N(d−1)/d)\ln Z=\ln Z_1+\ln Z_2+O(N^{(d-1)/d}), so the free energy and the entropy are additive to leading order, S=S1+S2S=S_1+S_2. For long-range forces where H12∼NH_{12}\sim N (every pair couples), this factorization fails and additivity is lost. Verified: numeric check confirms Esurface/Ebulk=N−1/dE_{\text{surface}}/E_{\text{bulk}}=N^{-1/d} for d=1,2,3d=1,2,3 across N=106N=10^6–102410^{24}; existence-of-thermodynamic-limit theorems (Ruelle, Lieb) require exactly such tempered short-range potentials (Kardar SPoP ch. 4).

Limiting cases

When does SS scale linearly with NN, and when does it break?

CaseResultMeaning
Short-range, thermodynamic limitS(λE,λV,λN)=λ S(E,V,N)S(\lambda E,\lambda V,\lambda N)=\lambda\,S(E,V,N)Standard regime: potentials decaying faster than r−dr^{-d} in dd dimensions. Surface energy is subextensive (∼N−1/d\sim N^{-1/d} of bulk); extensivity and additivity both hold.
Long-range interactionsEint∼N2, S∼N5/3 ⇒ Ω≠Ω1Ω2E_{\text{int}}\sim N^2,\ S\sim N^{5/3}\ \Rightarrow\ \Omega\neq\Omega_1\Omega_2Gravity (1/r1/r), unscreened Coulomb. Energy is non-additive; ensembles inequivalent; microcanonical negative specific heat appears. Kac rescaling Eint/NE_{\text{int}}/N restores a formal extensivity but with non-concave S(E)S(E).
Finite / mesoscopic systemsS=aN+bN2/3+…S = aN + bN^{2/3} + \dotsSurface terms ∼N2/3\sim N^{2/3} are not negligible for small NN; strict extensivity is only the leading-order N→∞N\to\infty behaviour.
Distinguishable localized modesScrystal=3NkB[1+ln⁡(kBT/ℏω)]S_{\text{crystal}}=3Nk_{\mathrm B}[1+\ln(k_{\mathrm B}T/\hbar\omega)] (no 1/N!1/N!)Oscillators fixed at lattice sites are distinguishable by position; the entropy is already extensive and must not be divided by N!N!.

Worked examples

Example 1 — The Gibbs paradox as a number. Compute the spurious mixing entropy that labelled counting assigns to combining two boxes of NN identical argon atoms at equal density, and show the 1/N!1/N! correction removes it.

Step 1. Labelled entropy of each half contains NkBln⁡VhNk_{\mathrm B}\ln V_h; combined system contains 2NkBln⁡(2Vh)2Nk_{\mathrm B}\ln(2V_h) (all 2N2N atoms share 2Vh2V_h).

Step 2. Naive change: ΔS=kB[2Nln⁡(2Vh)−2Nln⁡Vh]=2NkBln⁡2\Delta S = k_{\mathrm B}[2N\ln(2V_h)-2N\ln V_h]=2Nk_{\mathrm B}\ln 2. For one mole, N=NAN=N_A and 2NAkBln⁡2=2Rln⁡2=2(8.314)(0.6931)=11.5 J K−12N_A k_{\mathrm B}\ln2 = 2R\ln2 = 2(8.314)(0.6931)=11.5\ \mathrm{J\,K^{-1}} of entropy conjured from nothing.

Step 3. With 1/N!1/N!, entropy depends on V/NV/N only. At equal density Vh/N=(2Vh)/(2N)V_h/N=(2V_h)/(2N), so ΔS=2NkBln⁡2Vh2N−2NkBln⁡VhN=0\Delta S = 2Nk_{\mathrm B}\ln\tfrac{2V_h}{2N} - 2Nk_{\mathrm B}\ln\tfrac{V_h}{N}=0. The naive answer is 2Rln⁡2≈11.5 J K−12R\ln2\approx11.5\ \mathrm{J\,K^{-1}} per mole of spurious entropy; the correct answer with indistinguishability is ΔS=0\Delta S=0. The gap is precisely the Gibbs paradox.

Example 2 — Absolute entropy of argon from Sackur–Tetrode. Evaluate the Sackur–Tetrode molar entropy of argon at standard conditions and compare with the measured value 154.8 J mol−1K−1154.8\ \mathrm{J\,mol^{-1}K^{-1}}. Argon: m=6.63×10−26 kgm=6.63\times10^{-26}\,\mathrm{kg}, T=298.15 KT=298.15\,\mathrm{K}, p=105 Pap=10^5\,\mathrm{Pa}.

Step 1. Thermal de Broglie wavelength λT=h/2πmkBT=(6.626×10−34)/2π(6.63×10−26)(1.381×10−23)(298.15)=1.60×10−11 m\lambda_T = h/\sqrt{2\pi m k_{\mathrm B}T} = (6.626\times10^{-34})/\sqrt{2\pi(6.63\times10^{-26})(1.381\times10^{-23})(298.15)} = 1.60\times10^{-11}\,\mathrm{m}.

Step 2. Volume per particle from the ideal-gas law: V/N=kBT/p=(1.381×10−23)(298.15)/105=4.12×10−26 m3V/N = k_{\mathrm B}T/p = (1.381\times10^{-23})(298.15)/10^5 = 4.12\times10^{-26}\,\mathrm{m^3}.

Step 3. The dimensionless log-argument is ln⁡ ⁣((V/N)λT−3)=ln⁡ ⁣(4.12×10−26/(1.60×10−11)3)=ln⁡(1.005×107)=16.12\ln\!\big((V/N)\lambda_T^{-3}\big) = \ln\!\big(4.12\times10^{-26}/(1.60\times10^{-11})^3\big) = \ln(1.005\times10^{7}) = 16.12. Why λT−3\lambda_T^{-3}: the momentum-space factor (4πmE/3Nh2)3/2(4\pi mE/3Nh^2)^{3/2} equals λT−3\lambda_T^{-3} for an ideal gas with E=32NkBTE=\tfrac32 Nk_{\mathrm B}T.

Step 4. So S/NkB=16.12+52=18.62S/Nk_{\mathrm B} = 16.12 + \tfrac52 = 18.62, and per mole Sm=18.62 R=18.62(8.314)=154.8 J mol−1K−1S_m = 18.62\,R = 18.62(8.314) = 154.8\ \mathrm{J\,mol^{-1}K^{-1}}. The Sackur–Tetrode prediction is 154.8 J mol−1K−1154.8\ \mathrm{J\,mol^{-1}K^{-1}}, matching the experimental standard molar entropy of argon to the third figure — a quantitative confirmation that the h3h^3 cell and 1/N!1/N! factor are physically real, not bookkeeping conveniences.

History band

Origins · 1 minJosiah Willard Gibbs and how this was discovered
JW
Josiah Willard Gibbs
1839–1903 · American mathematical physicist who founded chemical thermodynamics and statistical mechanics; his 1875–78 memoir "On the Equilibrium of Heterogeneous Substances" introduced the chemical potential and the mixing-entropy analysis now bearing his name, and his 1902 "Elementary Principles in Statistical Mechanics" coined the term "statistical mechanics" and the ensemble framework. The Gibbs paradox — that labelled counting spuriously raises entropy on mixing identical gases — sharpened the question of indistinguishability decades before quantum mechanics answered it.

History
1865
— Clausius names the state function "entropy" and states dS = dQ_rev/T
1875
— Gibbs begins "On the Equilibrium of Heterogeneous Substances", introducing the chemical potential
1876
— Gibbs analyzes the entropy of mixing and identifies the paradox for identical gases
1877
— Boltzmann relates entropy to microstate counting, S = k ln W (the constant k is Planck's later notation)
1902
— Gibbs publishes "Elementary Principles in Statistical Mechanics", the ensemble framework
1912
— Sackur and Tetrode independently derive the absolute ideal-gas entropy using Planck's h
1931
— theorems on the existence of the thermodynamic limit for short-range potentials (later Ruelle, Lieb) formalized

Going further

References. Pathria & Beale, Statistical Mechanics, 3rd ed., §1.5–1.6 (Gibbs paradox, Sackur–Tetrode) · Kardar, Statistical Physics of Particles, ch. 4 · Reif, Fundamentals of Statistical and Thermal Physics, §7.3 and §2.5 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, ch. 3 · Landau & Lifshitz, Statistical Physics Part 1, §7, §24 · Campa, Dauxois, Ruffo, Physics Reports 480 (2009) 57 — long-range interactions and non-additivity.

Provenance. All equations are standard textbook results; Sackur–Tetrode and the Gibbs paradox follow Pathria & Beale §1.5–1.6 and Reif §7.3, and the short-range condition for the thermodynamic limit follows Kardar SPoP ch. 4 (Ruelle/Lieb). Numerical check: standard molar entropy of argon =154.8 J mol−1K−1=154.8\,\mathrm{J\,mol^{-1}K^{-1}} (NIST/CODATA); kB=1.380649×10−23 J K−1k_{\mathrm B}=1.380649\times10^{-23}\,\mathrm{J\,K^{-1}}, R=8.314 J mol−1K−1R=8.314\,\mathrm{J\,mol^{-1}K^{-1}}. A verifier should recompute λT\lambda_T, V/NV/N at STP, the Sackur–Tetrode value, the mixing-entropy formula, and the N−1/dN^{-1/d} surface-to-bulk scaling. Base-migration note: the source draft mislabelled the argon intermediates (ln⁡\ln-argument 18.618.6, S/NkBS/Nk_{\mathrm B} 21.121.1); the correct chain is ln⁡\ln-argument 16.1216.12, S/NkB=18.62S/Nk_{\mathrm B}=18.62, giving the same final 154.8 J mol−1K−1154.8\ \mathrm{J\,mol^{-1}K^{-1}} — corrected here and reflected in the worked example and cheat sheet.

Builds on: Boltzmann Entropy · Accessible Phase Space and Energy Shells · Microstates and Macrostates · Phase Space Leads to: Statistical Ensembles · Gibbs Entropy · Equal A Priori Probabilities

Additive and extensive sound like the same thing — are they?

They are closely related but not identical. Additive means the entropy of a composite equals the sum of its parts, S=S1+S2S=S_1+S_2; it is a statement about combining independent systems. Extensive means SS is a homogeneous function of degree one, S(λE,λV,λN)=λSS(\lambda E,\lambda V,\lambda N)=\lambda S; it is additivity applied recursively to identical replicas. Additivity requires only short-range interactions (so counts factorize); extensivity requires additivity plus correct indistinguishability counting (the 1/N!1/N!), because without it even a single homogeneous gas fails to scale linearly.

Where does the factor of 5/2 in Sackur–Tetrode actually come from?

Two pieces add up. The 32\tfrac32 is the momentum-space (kinetic) contribution: integrating over the 3N3N-dimensional momentum ball on the energy shell gives an E3N/2E^{3N/2} factor, hence 32\tfrac32 per particle after taking the log and dividing by NN. The extra +1+1 comes from Stirling's approximation to N!N!: ln⁡N!≈Nln⁡N−N\ln N!\approx N\ln N - N, and the −N-N (i.e. +1+1 per particle after the sign flips through −kBln⁡N!-k_{\mathrm B}\ln N!) lifts 32\tfrac32 to 52\tfrac52. So the 52\tfrac52 literally encodes both the kinetic degrees of freedom and the indistinguishability correction.

If I mix two gases that differ only by isotope, is the mixing entropy zero or positive?

Positive. Different isotopes are genuinely distinct species — they have different masses and are, in principle, distinguishable — so each expands into the full volume and its own V/NiV/N_i changes, giving ΔSmix=−NkB∑ixiln⁡xi>0\Delta S_{\text{mix}}=-Nk_{\mathrm B}\sum_i x_i\ln x_i>0. This is not a technicality: it is why isotope separation costs free energy (you must pay back the mixing entropy to un-mix), and it is the thermodynamic basis of enrichment. Only truly identical particles — same isotope, same internal state — give zero mixing entropy.

Why does gravity break extensivity when electromagnetism does not?

Both are 1/r1/r forces, but electromagnetic charges come in two signs and screen: in any neutral plasma the effective interaction is cut off beyond the Debye length, making it effectively short-range, so entropy is extensive. Gravity has only one sign (mass is always attractive), so there is no screening; the interaction energy of NN masses grows as N2N^2 and the entropy as N5/3N^{5/3}. That superextensivity is why self-gravitating systems have non-additive entropy, negative specific heat, and inequivalent ensembles — genuinely different thermodynamics.

Does the 1/N!1/N! mean classical particles are "secretly quantum"?

In a sense, yes — and that is the striking part. Purely classical statistical mechanics cannot justify the 1/N!1/N! on its own; it is imposed only because extensivity demands it. Quantum mechanics explains it: identical particles are described by (anti)symmetrized wavefunctions in which permutations are not distinct states, so indistinguishability is built in from the start. The classical 1/N!1/N! is the shadow this quantum fact casts on the classical count. Likewise the h3Nh^{3N} cell size is the shadow of phase-space quantization. Both are quantum corrections that classical thermodynamics could not derive but could not do without.

Is the entropy of a small nanoparticle extensive?

Not strictly. For a finite system the entropy carries surface corrections, S=aN+bN2/3+…S = aN + bN^{2/3} + \dots, where the N2/3N^{2/3} term counts atoms on the surface. For N∼1024N\sim10^{24} this term is one part in 10810^{8} and utterly negligible, but for a nanoparticle of a few thousand atoms it is a percent-level correction that matters for melting-point depression, catalytic activity, and thermodynamic stability. Extensivity is an asymptotic (N→∞N\to\infty) statement; treat it with care in the mesoscopic world.

Could I define entropy without the logarithm and keep additivity?

No, and this is the deep reason the logarithm is not arbitrary. Additivity demands a function ff with f(Ω1Ω2)=f(Ω1)+f(Ω2)f(\Omega_1\Omega_2)=f(\Omega_1)+f(\Omega_2) — that is, ff must turn products into sums. The only continuous solution is f(Ω)=kln⁡Ωf(\Omega)=k\ln\Omega for some constant kk. Any other choice (say Ω\Omega itself, or Ω\sqrt\Omega) fails to be additive for independent subsystems. So the moment you insist entropy add when you combine independent systems, Boltzmann's S=kBln⁡ΩS=k_{\mathrm B}\ln\Omega is forced on you up to the units-fixing constant kBk_{\mathrm B}.

Before this

Where this leads