Factorization of the Partition Function

A mole of gas has something like 102310^{23} particles, each with three momentum components and three positions — a state space so vast that writing down its partition function directly, state by state, is not merely hard but physically impossible. And yet the ideal gas is a textbook problem, solved in a paragraph. The bridge between the impossible and the elementary is one algebraic observation: when the total energy is a sum of independent pieces, the partition function is a product of their partition functions. A sum in the exponent becomes a product of exponentials, and the astronomically large sum collapses into a handful of single-mode calculations. This is factorization, and it is the single most powerful computational move in equilibrium statistical mechanics. If H=∑aHaH=\sum_a H_a with the pieces acting on independent degrees of freedom, then Z=∏aZaZ=\prod_a Z_a, and — taking the logarithm — ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a. That logarithm is the whole point: because thermodynamic potentials are logarithms of ZZ, factorization is the microscopic origin of extensivity. Double the number of independent modes and you double ln⁡Z\ln Z, hence double the free energy, the energy, and the entropy. The three statements "no interaction," "energies add," and "the free energy is additive" are one statement viewed from three angles. The reach is enormous. The independent pieces can be separate subsystems, separate particles (an ideal gas, with the Gibbs 1/N!1/N! for indistinguishability), or the separate motions of a single molecule — translation, rotation, vibration, electronic. This article's owned result is that factorization is equivalent to the additivity of every extensive quantity, and its punchline is the diatomic heat-capacity staircase: CVC_V climbs from 32R\tfrac32R to 52R\tfrac52R to 72R\tfrac72R as rotation and then vibration unfreeze — three plateaus that fall straight out of Z=ZtrZrotZvibZ=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}. Every number here is python-verified.

Key takeaways
  • When the energy is a sum of independent contributions, H=∑aHaH=\sum_a H_a, the partition function factorizes: Z=∏aZaZ=\prod_a Z_a, because e−β∑aHa=∏ae−βHae^{-\beta\sum_a H_a}=\prod_a e^{-\beta H_a}.
  • Taking the log makes it additive: ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a, so FF, UU, SS, and CVC_V are all sums over the independent pieces — factorization is extensivity.
  • For NN independent identical particles, Z=Z1N/N!Z=Z_1^N/N!; the Gibbs 1/N!1/N! restores an extensive entropy and resolves the Gibbs paradox.
  • A single molecule factorizes over its motions: Z1=ZtrZrotZvibZelZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}Z_{\text{el}}, so its heat capacity is the sum of the mode contributions.
  • The payoff is the diatomic CVC_V staircase: 32R→52R→72R\tfrac32R\to\tfrac52R\to\tfrac72R as rotation then vibration unfreeze with rising TT.
  • Key idea: a sum in the exponent becomes a product of partition functions, so ln⁡Z\ln Z — and therefore all of thermodynamics — is additive over independent degrees of freedom. Factorization fails exactly when interactions couple the pieces, and that failure is where all the hard physics begins.
The core insight

When the Hamiltonian splits into a sum of independent pieces H=∑aHaH=\sum_a H_a, the partition function factorizes Z=∏aZaZ=\prod_a Z_a and ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a. Every extensive quantity (UU, FF, SS, CVC_V) then adds over the pieces — factorization is the microscopic origin of extensivity. It collapses a many-body sum to single-mode calculations, and it fails precisely when interactions couple the degrees of freedom.

Where this lives today

Factorization is the workhorse of computational thermochemistry. Software that predicts reaction rates, equilibrium constants, and thermodynamic tables constructs each molecule's partition function as the product Z1=ZtrZrotZvibZelZ_1=Z_{\rm tr}Z_{\rm rot}Z_{\rm vib}Z_{\rm el}, using rotational constants and vibrational frequencies obtained from quantum-chemistry calculations or spectroscopy. Transition-state theory — the backbone of chemical kinetics — computes a rate constant as a ratio of such factorized partition functions. The entire discipline of statistical thermodynamics in chemistry is, operationally, the art of factoring ZZ correctly and knowing when the factorization breaks (anharmonicity, internal rotation, mode coupling). In condensed-matter physics and quantum field theory, factorization provides the zeroth-order starting point for nearly every calculation. A crystal's phonons and a cavity's photons are treated as independent normal modes, so their partition functions are products over kk, giving the Debye and Planck laws. When interactions are present, one begins with the factorized non-interacting partition function Z0Z_0 and treats the coupling perturbatively. The cluster expansion, virial expansion, and diagrammatic many-body theory are systematic corrections to this factorized starting point. Even in machine learning, "mean-field" approximations to intractable probabilistic models work by forcing a factorized (product) form on a distribution that does not truly factorize, then correcting — the same tension between independence and interaction that runs through all of statistical physics.

The physical picture

Roll several dice at once. Because the dice are independent, the number of ways to obtain a particular combination of faces is the product of the numbers of ways for the individual dice—the choices multiply. The partition function is exactly a weighted count of microstates, so independent degrees of freedom multiply their ZZ's. That is the entire mechanism: independence of the pieces ⇒\Rightarrow additivity of energies in the exponent ⇒\Rightarrow product of Boltzmann factors ⇒\Rightarrow product of partition functions.

Figure
Independent pieces multiply: a joint microstate is one choice from each subsystem, so the total count Z factorizes into the product of the pieces' counts Z₁ × Z₂ × Z₃.
Independent subsystems — energies add, weights multiply piece 1 Z₁ × piece 2 Z₂ × piece 3 Z₃ = Z = Z₁Z₂Z₃ ln Z = Σ ln Zₐ

The deep consequence lies in the logarithm. Because F=−kBTln⁡ZF=-k_B T\ln Z, U=−∂βln⁡ZU=-\partial_\beta\ln Z, and S=−∂TFS=-\partial_TF are all derived from ln⁡Z\ln Z, and because ln⁡\ln converts the product Z=∏aZaZ=\prod_a Z_a into the sum ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a, every extensive quantity inherits additivity from factorization. This is not a coincidence to be memorized; it is why extensivity exists at all. A macroscopic system is extensive precisely to the extent that it is built from weakly-coupled independent pieces — and the moment genuine long-range or strong interactions couple those pieces, both factorization and simple extensivity break down together (self-gravitating systems, which are non-extensive, are the classic warning). The most beautiful payoff is a single molecule factorizing over its own motions. A diatomic molecule stores energy in translation (3 directions), rotation (2 axes), and vibration (1 stretch mode), and to an excellent approximation these are independent, so Z1=ZtrZrotZvibZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}. Each motion has its own characteristic temperature below which it is quantum-mechanically "frozen out." As you heat the gas, the modes switch on one at a time, and the heat capacity climbs in discrete steps — the famous staircase below, computed directly from the factorized ZZ.

Figure
The diatomic heat-capacity staircase from Z = Z_tr Z_rot Z_vib: C_V/R climbs 3/2 → 5/2 → 7/2 as rotation (near θ_rot) then vibration (near θ_vib) unfreeze.
log T →C_V/R 3/2 5/2 7/2 θ_rot θ_vib translation only + rotation + vibration = 7/2

The core equations

A system's degrees of freedom are independent when its Hamiltonian is a sum of pieces that act on separate state spaces (they commute, and no term couples them). This is the precondition for everything that follows — the definition of "non-interacting":

H=∑a=1MHa,[Ha,Hb]=0(1)H=\sum_{a=1}^{M} H_a,\qquad [H_a,H_b]=0 \qquad (1)

where: HH — total Hamiltonian; HaH_a — the Hamiltonian of the aa-th independent piece (a subsystem, a particle, or a single mode); MM — number of independent pieces; [Ha,Hb]=0[H_a,H_b]=0 means the pieces live in independent state spaces. There are no cross terms VabV_{ab}; the instant one appears, this equation and its consequences fail. Because the exponential of a sum of commuting operators factorizes into the product of exponentials, and because the trace over a product Hilbert space also factorizes, the partition function factorizes:

Z=Tr e−βH=∏a=1MTra e−βHa=∏a=1MZa(2)Z=\mathrm{Tr}\,e^{-\beta H}=\prod_{a=1}^{M}\mathrm{Tr}_a\,e^{-\beta H_a}=\prod_{a=1}^{M}Z_a \qquad (2)

where: β=1/kBT\beta=1/k_BT; Tra\mathrm{Tr}_a — trace over the state space of piece aa alone; ZaZ_a — its partition function. The equilibrium probability distribution factorizes into independent marginals, P=∏aPaP=\prod_a P_a, where Pa=e−βHa/ZaP_a=e^{-\beta H_a}/Z_a. This factorization is precisely the statistical signature of independent degrees of freedom. Taking the logarithm is where the physics lives, because it converts the product into the additive quantity that all thermodynamic potentials are built from:

ln⁡Z=∑a=1Mln⁡Za,F=−kBTln⁡Z=∑a=1MFa(3)\ln Z=\sum_{a=1}^{M}\ln Z_a,\qquad F=-k_BT\ln Z=\sum_{a=1}^{M}F_a \qquad (3)

where: Fa=−kBTln⁡ZaF_a=-k_BT\ln Z_a — the free energy of piece aa. Every extensive quantity now adds: U=∑aUaU=\sum_a U_a, S=∑aSaS=\sum_a S_a, CV=∑aCV,aC_V=\sum_a C_{V,a}. Reach for this whenever a system is a collection of weakly-coupled parts — it turns one hard problem into MM easy ones. For NN identical particles the naive product Z1NZ_1^N overcounts, because relabeling identical particles does not give a new physical state; the Gibbs factor 1/N!1/N! corrects this in the dilute (classical) regime:

ZN=Z1NN!,Z1=VλT3,λT=h2πmkBT(4)Z_N=\frac{Z_1^N}{N!},\qquad Z_1=\frac{V}{\lambda_T^3},\qquad \lambda_T=\frac{h}{\sqrt{2\pi m k_BT}} \qquad (4)

where: Z1Z_1 — single-particle partition function; λT\lambda_T — thermal de Broglie wavelength; N!N! — Gibbs indistinguishability factor (essential for extensive SS). Without the 1/N!1/N!, the ideal-gas entropy is not extensive and you resurrect the Gibbs paradox of mixing identical gases. Inside a single molecule the same logic applies to its separable motions, and their partition functions multiply:

Z1=Ztr Zrot Zvib Zel,ε=εtr+εrot+εvib+εel(5)Z_1=Z_{\text{tr}}\,Z_{\text{rot}}\,Z_{\text{vib}}\,Z_{\text{el}},\qquad \varepsilon=\varepsilon_{\text{tr}}+\varepsilon_{\text{rot}}+\varepsilon_{\text{vib}}+\varepsilon_{\text{el}} \qquad (5)

where: each factor is the partition function of one kind of motion. The vibrational factor for a single mode of frequency ω\omega is Zvib=e−βℏω/2/(1−e−βℏω)=1/[2sinh⁡(βℏω/2)]Z_{\text{vib}}=e^{-\beta\hbar\omega/2}/(1-e^{-\beta\hbar\omega})=1/[2\sinh(\beta\hbar\omega/2)], and a crystal's phonons factorize further into a product over normal modes kk.

Derivation AFactorization is equivalent to additivity of every extensive quantity

This article's central structural result is that factorization of ZZ is not merely a computational trick — it is mathematically equivalent to the additivity of every extensive thermodynamic quantity. The goal is to show that Z=∏aZaZ=\prod_a Z_a implies U=∑aUaU=\sum_a U_a, F=∑aFaF=\sum_a F_a, S=∑aSaS=\sum_a S_a, and CV=∑aCV,aC_V=\sum_a C_{V,a}, so that "the pieces do not interact" and "the thermodynamics adds up" are equivalent statements. The strategy is to take the logarithm once, then differentiate it in the four ways that generate the four potentials, and watch each derivative distribute over the sum.

Step 1. Take the logarithm of the factorized partition function. Since Z=∏aZaZ=\prod_a Z_a, it follows immediately that ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a. Why: the logarithm of a product is the sum of the logarithms — this single identity is the seed of all the additivity below.

Step 2. Free energy is additive. F=−kBTln⁡Z=−kBT∑aln⁡Za=∑aFaF=-k_BT\ln Z=-k_BT\sum_a\ln Z_a=\sum_a F_a, with Fa=−kBTln⁡ZaF_a=-k_BT\ln Z_a. Why: FF is linear in ln⁡Z\ln Z, so it distributes over the sum immediately — the free energy of the whole is the sum of the free energies of the independent parts.

Step 3. Internal energy is additive. U=−∂βln⁡Z=−∂β∑aln⁡Za=∑a(−∂βln⁡Za)=∑aUaU=-\partial_\beta\ln Z=-\partial_\beta\sum_a\ln Z_a=\sum_a(-\partial_\beta\ln Z_a)=\sum_a U_a. Why: differentiation is linear, so ∂β\partial_\beta passes through the sum; each term is exactly the energy of one piece, so the total energy is additive.

Step 4. Entropy and heat capacity are additive. Differentiating U=∑aUaU=\sum_a U_a with respect to TT gives CV=∑aCV,aC_V=\sum_a C_{V,a}, and S=−∂TF=−∂T∑aFa=∑aSaS=-\partial_TF=-\partial_T\sum_a F_a=\sum_a S_a. Why: both CVC_V and SS are further derivatives of the already-additive UU and FF, so additivity propagates to every extensive quantity — this is why we can add the translational, rotational, and vibrational heat capacities of a molecule. *These three results — ln⁡(Z1Z2)=ln⁡Z1+ln⁡Z2\ln(Z_1Z_2)=\ln Z_1+\ln Z_2; U=−∂βln⁡ZU=-\partial_\beta\ln Z additive; and CVC_V additive for two independent oscillators — all hold exactly and can be confirmed by direct symbolic computation.*

Go deeper · Derivation B · 2 minThe diatomic heat-capacity staircase from the factorized molecular Z
Derivation BThe diatomic heat-capacity staircase from the factorized molecular Z

The goal is to run the factorized molecular partition function all the way to the observable heat-capacity staircase: compute Z1=ZtrZrotZvibZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}, take the log, and read off CVC_V in three temperature regimes, obtaining 32R→52R→72R\tfrac32R\to\tfrac52R\to\tfrac72R as rotation and then vibration unfreeze. The strategy is to use the additivity just proved — the total CVC_V is the sum of the mode contributions — and to evaluate each mode's contribution in the limits set by its characteristic temperature.

Step 1. Split the heat capacity by factorization. Since Z1=ZtrZrotZvibZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}, the molar heat capacity is CV=Ctr+Crot+CvibC_V=C_{\text{tr}}+C_{\text{rot}}+C_{\text{vib}}. Translation always contributes Ctr=32RC_{\text{tr}}=\tfrac32R (three quadratic momentum terms, classical at any relevant TT). Why: additivity from factorization lets us treat each motion in isolation and sum, exactly as in the previous derivation.

Step 2. Rotation switches on near its characteristic temperature θrot=ℏ2/2IkB\theta_{\text{rot}}=\hbar^2/2Ik_B. For T≪θrotT\ll\theta_{\text{rot}} the rotor is frozen (Crot→0C_{\text{rot}}\to0); for T≫θrotT\gg\theta_{\text{rot}} a linear rotor reaches the classical value Crot→RC_{\text{rot}}\to R (two rotational degrees of freedom, 12R\tfrac12R each). Why: the level spacing ∼kBθrot\sim k_B\theta_{\text{rot}} sets the temperature at which thermal energy can excite rotations; below it, rotation cannot absorb heat.

Step 3. Vibration switches on near θvib=ℏω/kB\theta_{\text{vib}}=\hbar\omega/k_B, which is much higher. Its Einstein contribution is Cvib=R x2ex/(ex−1)2C_{\text{vib}}=R\,x^2e^x/(e^x-1)^2 with x=θvib/Tx=\theta_{\text{vib}}/T: this →0\to0 as x→∞x\to\infty (frozen) and →R\to R as x→0x\to0 (fully active). Why: a vibration is a single quantum oscillator; because θvib≫θrot\theta_{\text{vib}}\gg\theta_{\text{rot}} for typical molecules, vibration unfreezes only at much higher temperature, giving a second step.

Step 4. Combine the contributions from each degree of freedom. Cold (T≪θrotT\ll\theta_{\text{rot}}): only translation, CV=32RC_V=\tfrac32R. Warm (θrot≪T≪θvib\theta_{\text{rot}}\ll T\ll\theta_{\text{vib}}): translation ++ rotation, CV=52RC_V=\tfrac52R. Hot (T≫θvibT\gg\theta_{\text{vib}}): all three, CV=72RC_V=\tfrac72R. Each step is exactly +R+R, the classical contribution of the newly-thawed mode. Why: because the modes are independent, unfreezing one simply adds its full classical heat capacity on top of the others — the staircase is additivity made visible. *The three plateaus 32R,52R,72R\tfrac32R,\tfrac52R,\tfrac72R and the +R+R steps, together with N2N_2 landing on the 52R\tfrac52R plateau at 300 K (CV≈20.8C_V\approx20.8 J/mol/K, matching experiment), follow directly from an exact rigid-rotor sum combined with the Einstein vibrational formula.*

Limiting cases

The behaviour of factorization across regimes:

CaseResultMeaning
Perfectly independentZ=∏aZaZ=\prod_a Z_a, ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a exactAll extensive quantities add; the many-body problem decouples completely.
NN distinguishable copiesZ=Z1NZ=Z_1^NFixed lattice sites (e.g. spins); no 1/N!1/N! because sites are labelled by position.
NN identical particles (dilute)Z=Z1N/N!Z=Z_1^N/N!Gibbs factor restores extensivity; valid when nλT3≪1n\lambda_T^3\ll1.
Single moleculeZ1=ZtrZrotZvibZelZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}Z_{\text{el}}Independent motions multiply; heat capacity is a staircase.
Weak interactionZ≈Z0 ⟨e−βV⟩0Z\approx Z_0\,\langle e^{-\beta V}\rangle_0Factorized Z0Z_0 is the backbone; the coupling is a perturbation/cumulant expansion.
Strong / long-range interactionfactorization failsCross terms generate correlations between degrees of freedom, leading to genuinely many-body phenomena such as phase transitions, criticality, and collective behaviour.

Worked examples

1 · The diatomic heat-capacity staircase, computed by factoring Z (a real, measurable number)

Take a model diatomic gas with rotational temperature θrot≈85\theta_{\text{rot}}\approx85 K and vibrational temperature θvib≈3374\theta_{\text{vib}}\approx3374 K (H2_2-like values). Using Z1=ZtrZrotZvibZ_1=Z_{\text{tr}}Z_{\text{rot}}Z_{\text{vib}}, find the molar CVC_V at (a) T=8T=8 K, (b) T=300T=300 K, and (c) T=40,000T=40{,}000 K, and identify the plateau in each case.

Step 1. By factorization, the molar heat capacity is the sum of the independent contributions, CV=Ctr+Crot+CvibC_V=C_{\text{tr}}+C_{\text{rot}}+C_{\text{vib}}, with Ctr=32RC_{\text{tr}}=\tfrac32R for all temperatures. Compute each mode from its own partition function (exact rigid-rotor sum for rotation, Einstein formula Cvib=R x2ex/(ex−1)2C_{\text{vib}}=R\,x^2e^x/(e^x-1)^2, x=θvib/Tx=\theta_{\text{vib}}/T for vibration).

Step 2. Low temperature, T=8 K≪θrotT=8\,{\rm K}\ll\theta_{\rm rot}: rotational and vibrational degrees of freedom are frozen, so Crot≈0C_{\rm rot}\approx0 and Cvib≈0C_{\rm vib}\approx0. So CV=32R=1.5×8.314=12.5 J ⋅ mol−1K−1C_V=\tfrac32R=1.5\times8.314=\mathbf{12.5\ \text{J}\,\cdot\,\text{mol}^{-1}\text{K}^{-1}} — the 32R\tfrac32R (translation-only) plateau.

Step 3. Intermediate temperature, T=300 K≫θrotT=300\,{\rm K}\gg\theta_{\rm rot} but T≪θvibT\ll\theta_{\rm vib}: rotational modes are fully excited (Crot≈RC_{\rm rot}\approx R), whereas vibrational modes remain essentially frozen (Cvib≈0.002RC_{\rm vib}\approx0.002R). So CV≈52R=2.5×8.314=20.8 J ⋅ mol−1K−1C_V\approx\tfrac52R=2.5\times8.314=\mathbf{20.8\ \text{J}\,\cdot\,\text{mol}^{-1}\text{K}^{-1}} — the 52R\tfrac52R plateau, exactly where real N2N_2 sits at room temperature.

Step 4. High temperature, T=40,000 K≫θvibT=40{,}000\,{\rm K}\gg\theta_{\rm vib}: vibrational modes are now fully excited, giving Cvib≈RC_{\rm vib}\approx R. So CV≈72R=3.5×8.314=29.1 J ⋅ mol−1K−1C_V\approx\tfrac72R=3.5\times8.314=\mathbf{29.1\ \text{J}\,\cdot\,\text{mol}^{-1}\text{K}^{-1}} — the 72R\tfrac72R plateau. The heat capacity climbed in two steps of exactly +R+R each — one when rotation thawed, one when vibration thawed — precisely because factorization makes the mode contributions add. The locations of these heat-capacity steps directly reveal the characteristic temperatures θrot\theta_{\rm rot} and θvib\theta_{\rm vib}, providing a thermodynamic measure of the molecular rotational and vibrational energy scales.

2 · Why the ideal-gas entropy needs the Gibbs 1/N! (extensivity level)

Show that factoring the ideal gas as Z1NZ_1^N (without 1/N!1/N!) gives a non-extensive entropy, while Z1N/N!Z_1^N/N! fixes it. Use Z1=V/λT3Z_1=V/\lambda_T^3.

Step 1. Without the Gibbs factor: ln⁡Z=Nln⁡(V/λT3)\ln Z=N\ln(V/\lambda_T^3), so F=−NkBTln⁡(V/λT3)F=-Nk_BT\ln(V/\lambda_T^3) and S=−∂TFS=-\partial_TF contains a term NkBln⁡VNk_B\ln V. Now double the system, N→2NN\to2N, V→2VV\to2V: the entropy per particle picks up kBln⁡(2V)−kBln⁡V=kBln⁡2≠0k_B\ln(2V)-k_B\ln V=k_B\ln2\neq0. The entropy is not extensive — it changes when you merely scale the system, which is physically absurd.

Step 2. With the Gibbs factor: ln⁡Z=Nln⁡(V/λT3)−ln⁡N!≈Nln⁡(V/NλT3)+N\ln Z=N\ln(V/\lambda_T^3)-\ln N!\approx N\ln(V/N\lambda_T^3)+N (Stirling). Now the VV appears only as the intensive combination V/NV/N. Doubling NN and VV together leaves V/NV/N unchanged, so the entropy per particle is unchanged — the entropy is extensive.

Step 3. The Gibbs factor 1/N!1/N! removes the overcounting of indistinguishable particle permutations. Using Stirling's approximation, ln⁡N!≃Nln⁡N−N\ln N!\simeq N\ln N-N, it replaces the non-extensive dependence on ln⁡V\ln V by the intensive combination ln⁡(V/N)\ln(V/N), thereby restoring extensivity. This is the Sackur–Tetrode entropy S=NkB[ln⁡(V/NλT3)+52]S=Nk_B[\ln(V/N\lambda_T^3)+\tfrac52], and it is what resolves the Gibbs paradox. Factorization got us to Z1NZ_1^N in one line; indistinguishability is the one correction that factorization alone does not supply — you must put the 1/N!1/N! in by hand (or, more deeply, get it from quantum statistics).

Origins · 1 minfree energy and how this was discovered
FE
free energy
thermodynamic potential (Helmholtz/Gibbs) · 1882

The Helmholtz free energy F=U−TS=−kBTln⁡ZF=U-TS=-k_BT\ln Z is the thermodynamic potential natural to a system at fixed temperature, volume, and particle number — and it is the quantity through which factorization delivers its power. Hermann von Helmholtz introduced the "free energy" in 1882 (in Zur Thermodynamik chemischer Vorgänge) as the portion of a system's internal energy available to do work at constant temperature, distinguishing it from the "bound" energy TSTS that stays locked up as heat. Its statistical-mechanical meaning, given by Gibbs, is the bridge relation F=−kBTln⁡ZF=-k_BT\ln Z. What makes FF the right variable for factorization is its additivity: because ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a for independent pieces, F=∑aFaF=\sum_a F_a, so the free energy of a composite non-interacting system is literally the sum of its parts' free energies. That additivity is the microscopic content of thermodynamic extensivity. Every equilibrium state minimizes FF at fixed (T,V,N)(T,V,N), and its derivatives generate the entropy (S=−∂TFS=-\partial_TF), the pressure (p=−∂VFp=-\partial_VF), and the chemical potential (μ=∂NF\mu=\partial_NF). The free energy is the workhorse potential of chemistry, materials science, and soft matter, and — as the logarithm of a partition function — it reappears wherever a normalizing constant does, from field theory to machine learning.

History
1868
— Boltzmann establishes the exponential energy weighting for a system in a heat bath.
1877
— Boltzmann connects entropy to the multiplicity of microstates, S = k log W.
1882
— Helmholtz introduces the free energy as the work-available part of the internal energy.
1902
— Gibbs's Elementary Principles gives the partition function and the bridge F = −kT ln Z their general form.
1911
— Sackur and Tetrode obtain the absolute entropy of a monatomic gas, forcing the Gibbs 1/N! and Planck's constant into the count.
1912
— Eucken measures the freezing-out of hydrogen's rotational heat capacity, an early confirmation of the mode staircase.

Going further

References. Pathria & Beale, Statistical Mechanics, 3rd ed., Ch. 3 · Kardar, Statistical Physics of Particles, Ch. 4 · Reif, Fundamentals of Statistical and Thermal Physics, Ch. 7 · McQuarrie, Statistical Mechanics, Ch. 6–8 (molecular partition functions) · Sethna, Statistical Mechanics, Ch. 6 · Gibbs, Elementary Principles in Statistical Mechanics (1902). Key results in this article: the additivity chain U=∑aUaU=\sum_aU_a, CV=∑aCV,aC_V=\sum_aC_{V,a} (confirmed symbolically for two oscillators); the diatomic staircase 32R→52R→72R\tfrac32R\to\tfrac52R\to\tfrac72R with +R+R steps (exact rigid-rotor sum ++ Einstein vibration); N2N_2 at 300 K on the 52R\tfrac52R plateau (CV≈20.8C_V\approx20.8 J·mol−1^{-1}K−1^{-1}); and ZN=Z1N/N!⇒Z_N=Z_1^N/N!\Rightarrow extensive F/NF/N. The numerical instances 12.5, 20.8, and 29.1 J·mol−1^{-1}K−1^{-1} use CODATA values of RR, hh, and kBk_B.

Builds on: Canonical Partition Function · Boltzmann Factor · Canonical Ensemble. Leads to: Helmholtz Free Energy from the Partition Function · Thermodynamic Quantities from the Partition Function · Grand Partition Function · Heat Capacity and Fluctuation-Response Relation.

Why does taking the logarithm matter so much — isn't Z the "real" quantity?

The logarithm is what turns factorization into physics. ZZ itself grows exponentially with system size — for a mole of particles ZZ is a number like e1023e^{10^{23}}, meaningless to write down. But ln⁡Z∼1023\ln Z\sim10^{23} is a sensible extensive quantity that scales linearly with the number of particles, and it is exactly what all the thermodynamic potentials are built from (F=−kBTln⁡ZF=-k_BT\ln Z, U=−∂βln⁡ZU=-\partial_\beta\ln Z, S=−∂TFS=-\partial_TF). When Z=∏aZaZ=\prod_a Z_a factorizes, the logarithm converts that product into the sum ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a, which is additive — the defining property of extensive quantities. So the reason thermodynamic potentials are logarithms of partition functions is precisely to inherit additivity from the factorization of ZZ. Working with ZZ directly, you would be multiplying astronomically large numbers; working with ln⁡Z\ln Z, you are adding sensible extensive contributions.

What exactly is a "characteristic temperature" like θ_rot or θ_vib, and why does a mode freeze below it?

A characteristic temperature converts a mode's quantum energy-level spacing into a temperature: θ=Δε/kB\theta=\Delta\varepsilon/k_B, where Δε\Delta\varepsilon is roughly the gap between the mode's lowest energy levels. For rotation θrot=ℏ2/2IkB\theta_{\text{rot}}=\hbar^2/2Ik_B (a few kelvin, since molecular moments of inertia II are large); for vibration θvib=ℏω/kB\theta_{\text{vib}}=\hbar\omega/k_B (thousands of kelvin, since bond-stretch frequencies are high). A mode "freezes" when T≪θT\ll\theta because the thermal energy kBTk_BT is then far smaller than the gap Δε\Delta\varepsilon needed to reach the first excited level. With no way to absorb energy in units of Δε\Delta\varepsilon, the mode is stuck in its ground state, contributes nothing to the heat capacity, and effectively disappears from the count. As TT rises through θ\theta, thermal fluctuations become large enough to excite the mode, it "thaws," and it adds its classical heat capacity. Because θvib≫θrot\theta_{\text{vib}}\gg\theta_{\text{rot}}, the modes thaw at well-separated temperatures — which is why you see a staircase rather than a single smooth rise.

Distinguishable versus indistinguishable — how do I know which one applies?

Ask whether the particles have fixed, labelled positions or whether they can wander and swap. If each "particle" sits at a fixed lattice site — spins in a magnet, atoms in a crystal, oscillators pinned to positions — then the sites are labelled by their location, swapping two of them gives a genuinely different (though equivalent-energy) configuration only if you track labels, but physically the particles are distinguishable by where they are, and you use Z=Z1NZ=Z_1^N with no 1/N!1/N!. If instead the particles form a gas, free to move and exchange places, then two configurations that differ only by relabeling identical particles are the same physical state, you have overcounted by N!N!, and you must divide: Z=Z1N/N!Z=Z_1^N/N!. The practical tell: a gas or liquid needs the Gibbs 1/N!1/N!; a lattice of fixed sites does not. And remember the 1/N!1/N! is only the dilute-limit shadow of full quantum indistinguishability — when the gas becomes dense or cold enough that nλT3∼1n\lambda_T^3\sim1, even the 1/N!1/N! is not enough and you must use Bose–Einstein or Fermi–Dirac statistics.

If factorization needs no interactions, how is it ever useful for real (interacting) systems?

In two complementary ways. First, an astonishing number of important systems are genuinely (or very nearly) non-interacting: the ideal gas, the modes of the electromagnetic field (photons), the normal modes of a crystal lattice (phonons), and the internal motions of an isolated molecule are all exactly factorizable, and they cover blackbody radiation, heat capacities of solids and gases, and thermochemistry. Second — and this is the deeper point — even when interactions are present, the factorized non-interacting partition function Z0Z_0 is the starting point for the calculation. You write Z=Z0⟨e−βV⟩0Z=Z_0\langle e^{-\beta V}\rangle_0 and expand the interaction VV perturbatively; the cluster expansion, the virial expansion, and diagrammatic many-body theory are all systematic corrections to a factorized backbone. So factorization is not just for toy problems: it is the zeroth-order skeleton on which essentially every interacting-system calculation is built. The failure of exact factorization is not a dead end — it is precisely the doorway to the physics of correlations and phase transitions.

Does factorization work the same way in quantum mechanics, with non-commuting operators?

It works whenever the pieces of the Hamiltonian commute, which is exactly the condition for them to describe independent degrees of freedom. If H=∑aHaH=\sum_aH_a with [Ha,Hb]=0[H_a,H_b]=0, then e−β∑aHa=∏ae−βHae^{-\beta\sum_aH_a}=\prod_ae^{-\beta H_a} (no Baker–Campbell–Hausdorff cross terms), and because independent degrees of freedom live in a tensor-product Hilbert space, the trace splits into a product of traces: Z=∏aTra e−βHa=∏aZaZ=\prod_a\mathrm{Tr}_a\,e^{-\beta H_a}=\prod_a Z_a. This is the quantum version, and it is what justifies factorizing over independent quantum numbers (translational, rotational, vibrational). The subtlety is that if two parts of the Hamiltonian do not commute — because a genuine interaction couples them — the exponential of the sum is no longer the product of exponentials, and factorization fails. So the commutator condition [Ha,Hb]=0[H_a,H_b]=0 is the precise quantum statement of "non-interacting," and it is the exact hypothesis under which ZZ factorizes.

Why is the free energy the right quantity to say "adds up," rather than the energy or entropy?

All three extensive quantities add for independent pieces — U=∑aUaU=\sum_aU_a, S=∑aSaS=\sum_aS_a, and F=∑aFaF=\sum_aF_a — but the free energy is the most direct consequence of factorization and the one that governs equilibrium. Directness: F=−kBTln⁡ZF=-k_BT\ln Z is linear in ln⁡Z\ln Z, so the moment ln⁡Z=∑aln⁡Za\ln Z=\sum_a\ln Z_a you have F=∑aFaF=\sum_aF_a in one step, whereas UU and SS require differentiating first. Governance: at fixed temperature, volume, and particle number, a system minimizes its free energy, so the additive F=∑aFaF=\sum_aF_a tells you that independent subsystems reach equilibrium independently — each part minimizes its own FaF_a. This is why chemists and physicists reach for the free energy when combining subsystems: it is additive, it is the quantity that decides which way a process runs, and its derivatives generate all the other thermodynamic quantities (S=−∂TFS=-\partial_TF, p=−∂VFp=-\partial_VF, μ=∂NF\mu=\partial_NF). Energy and entropy add too, but the free energy is where the additivity and the equilibrium principle meet.

Before this

Where this leads