Heat Capacity and the Fluctuation-Response Relation
Poke a system with a change in temperature and it absorbs energy; how much it absorbs per degree is the heat capacity . Leave that same system utterly alone in a heat bath and its energy still trembles — trading quanta with the bath, wandering above and below its mean. These look like two unrelated facts, one about response to a deliberate push, one about spontaneous jitter at rest. The central surprise of this article is that they are the same number: the heat capacity is exactly the variance of the equilibrium energy fluctuations, divided by . This identity, , is the simplest fluctuation–response (or fluctuation–dissipation) relation in physics — the prototype of a family that also links magnetic susceptibility to spin fluctuations and compressibility to density fluctuations. Its companion article, Energy Fluctuations in the Canonical Ensemble, derives the identity from ; here we read it the other way. Instead of asking "how big are the fluctuations?" we ask "what does the fluctuation tell us?" — and the answer is a response coefficient you can measure with a calorimeter, or extract from a simulation without ever touching the temperature. Two consequences fall out at once. Because a variance can never be negative, is guaranteed — thermodynamic stability is baked into the statistics, not assumed. And because energies of independent parts add, the relative energy fluctuation shrinks as , which is precisely why the fluctuating canonical energy behaves like the fixed microcanonical one for macroscopic matter. The article's owned result makes the "response tracks fluctuation" slogan quantitative on the two-level system, and every number here is python-verified.
- The heat capacity is a response: energy absorbed per degree of warming.
- In the canonical ensemble it equals a fluctuation: — the simplest fluctuation–dissipation relation.
- Because a variance is non-negative, this forces — thermodynamic stability guaranteed by statistics, not postulated.
- Relative energy fluctuations scale as , so canonical and microcanonical ensembles agree for macroscopic systems (ensemble equivalence).
- A diverging at a continuous phase transition is a diverging fluctuation — the gateway to critical phenomena.
- Key idea: the heat capacity you measure by warming a system is identically the size of the energy jitter the system undergoes at rest — response equals fluctuation, .
The constant-volume heat capacity, a response to changing temperature, is identically the fluctuation of the equilibrium energy: . Since a variance is non-negative, automatically (stability), and since the relative fluctuation vanishes as (ensemble equivalence). This is the prototype fluctuation–dissipation relation.
Where this lives today
The fluctuation–response relation is the daily workhorse of computational statistical mechanics. In Monte Carlo and molecular-dynamics simulations, one almost never obtains the heat capacity by numerically differentiating — that amplifies statistical noise ruinously. Instead is read directly from the measured energy variance in a single run at fixed : . The same trick gives the magnetic susceptibility from magnetization variance and the compressibility from particle-number variance. Continuous phase transitions are often identified by the growth or divergence of energy fluctuations (equivalently, anomalies in the heat capacity). Classic examples include the logarithmic heat-capacity singularity of the two-dimensional Ising model, the -anomaly of liquid helium, and heat-capacity anomalies associated with melting transitions. Finite-size scaling of the heat-capacity or energy-fluctuation peak then provides estimates of the critical temperature and critical exponents. Beyond equilibrium thermodynamics, the same principle powers modern measurement. Passive microrheology infers the viscoelastic response of a cell or polymer network purely from the thermal jiggling of an embedded bead — the fluctuation spectrum, via the fluctuation–dissipation theorem, is the response spectrum. In electronics, Johnson–Nyquist noise sets the temperature-dependent noise floor of every resistor, and is used in reverse as a primary thermometer (Johnson-noise thermometry) traceable to itself: equilibrium fluctuations and thermodynamic response are linked by temperature through the fluctuation–response relation.
The physical picture
Picture a small copper block clamped in thermal contact with a large water bath. Its energy is not a fixed number — it drifts up and down as it swaps thermal quanta with the bath. Now ask two questions about that block. Response: if I nudge the bath temperature up by one kelvin, how much energy does the block soak up? That is . Fluctuation: if I just watch the block sit at fixed temperature, how widely does its energy wander around the mean? That is . The claim of this article is that these are one measurement in disguise. The reason is that both are controlled by the same feature of the energy spectrum. A block whose accessible states are densely spread around the current thermal energy can readily shuffle energy around: it fluctuates a lot, and it also absorbs a lot when warmed. A block with a big gap up to its next states is stiff both ways — it barely fluctuates, and it barely responds. Large equilibrium energy fluctuations and a large heat capacity are two aspects of the same underlying physics. Formally, the Boltzmann weight is a moment-generating engine in the variable : one derivative of gives the mean energy, a second gives its variance, and since temperature enters only through , the temperature-derivative of the mean (the heat capacity) is forced to be the variance up to the fixed factor .
A particularly instructive example is the two-level (Schottky) system: ions each with a ground state and one excited state a gap above. As you warm it from absolute zero, the heat capacity rises, reaches a peak, then falls again — a distinctive bump. Why a peak and not a monotone rise? The energy variance per ion increases monotonically with temperature and approaches the limiting value as , where the two energy levels are equally populated. It is the factor in that turns that monotone fluctuation into a peaked response — the fluctuation is largest at high , but the response is weighted toward lower . The peak sits at (that is ), and experimentalists read the level gap straight off the peak temperature. This is how a two-level structure — nuclear spins, crystal-field doublets — is detected in a real material.
Finally, the smallness is why thermodynamics is possible at all. A kilogram of copper has atoms, so its relative energy fluctuation is about one part in — completely invisible on any macroscopic scale. Yet those microscopic, invisible fluctuations are exactly what fix the macroscopic you read off a calorimeter. Although equilibrium energy fluctuations are imperceptibly small in macroscopic systems, they determine the measurable heat capacity through the fluctuation–response relation.
The core equations
The heat capacity at constant volume is the thermodynamic definition we start from — the response of the mean energy to a change in the bath temperature at fixed :
where: — constant-volume heat capacity (a response coefficient); — mean internal energy; — absolute temperature; held fixed. This is what a calorimeter measures: divide the heat supplied by the temperature rise. The mean energy and its variance are obtained from the first and second derivatives of with respect to (derived in full in Energy Fluctuations in the Canonical Ensemble). We recall them because they are the bridge from the spectrum to the response:
where: — canonical partition function; — variance of the energy in the canonical distribution; — Boltzmann constant. The logarithm of the partition function, , is the cumulant-generating function for the energy, so its first derivative gives the mean energy and its second derivative gives the energy variance. The central result of the article — the fluctuation–response relation — states that the response is the fluctuation , scaled by :
where: the numerator is a spontaneous equilibrium fluctuation, the left side is a driven thermal response, and is the exact conversion factor. Read left-to-right, Eq. (3) is the fluctuation–response relation for energy; read right-to-left, it provides a practical way to compute from equilibrium energy fluctuations measured in a simulation.
Because the right-hand side is a variance over , and both are non-negative, stability is immediate — a statistical guarantee, not a thermodynamic postulate:
where: follows because (a variance) and . A material with negative at fixed would need a negative variance — impossible. (Self-gravitating systems appear to violate this, but they are not in the canonical ensemble; see the warning below.) The same content appears as the concavity of the free energy in temperature, the route most useful for thermodynamic manipulations:
where: — Helmholtz free energy; — entropy. is equivalent to being concave — the temperature-stability condition of thermodynamics.
This is the load-bearing identity of the article: we prove that the thermodynamic response is exactly the statistical fluctuation divided by , starting only from the definition of and the partition-function expression for . The strategy is to differentiate the mean energy with respect to , convert the -derivative into a -derivative via the chain rule, recognize the second log-derivative of as the variance, and watch two minus signs conspire to make the result manifestly positive.
Step 1. Write the response as a -derivative. By definition . Since , the chain rule gives with , so . Why: temperature enters the canonical distribution only through , so every temperature-response is really a -response, carried across by the Jacobian .
Step 2. Differentiate the mean energy. With , we have . From the generating-function structure, , so . Why: the second derivative of is the variance — the quotient rule turns minus into .
Step 3. Combine the two minus signs. Substituting into Step 1, . Why: the Jacobian carries one minus sign and carries another; they cancel, leaving a manifestly positive ratio of a variance to a positive number.
Step 4. Read off stability. Because (it is a variance) and , Eq. (3) immediately implies . Equivalently, means is concave — the thermodynamic stability condition emerges as a corollary of the positivity of a variance. Why: statistical mechanics does not need to postulate ; it inherits it from the unassailable fact that a variance cannot be negative.
Go deeper · Derivation B · 2 minThe Schottky bump: why the response peaks though the fluctuation does not
Here is the article's owned structural result, made quantitative on the two-level system. The goal is to explain the distinctive peak in the Schottky heat capacity: we compute the per-ion energy variance and the heat capacity as functions of temperature, show that the variance is monotone (it only grows and saturates), and prove that the peak in is entirely manufactured by the weighting in . This is "response tracks fluctuation" made exact — the two curves are the same object, reweighted.
Step 1. Set up the spectrum. Each ion has levels and , so and . The per-ion energy variance is . Why: differentiating once more with respect to , or directly forming with , gives the standard two-level variance.
Step 2. Show the variance is monotone in . Writing , the per-ion variance is . As a function of this decreases monotonically for ; as a function of temperature it therefore increases monotonically, rising from at and saturating at as . There is no interior peak in the fluctuation. Why: at high both levels are equally populated (), giving the maximal spread ; the fluctuation just grows toward that ceiling.
Step 3. Form the heat capacity and find its peak. Now . The extra suppresses the high- region and creates an interior maximum. Setting gives a transcendental equation whose root is , i.e. the peak sits at , with peak value . Why: multiplying a monotone-decreasing by a rising produces a single interior peak — the Schottky anomaly — located where the two tendencies balance.
Step 4. State the connection honestly. The fluctuation and the response are not peaked at the same temperature — the fluctuation has no finite- peak at all. What is exact is the pointwise identity at every temperature: the response is the fluctuation, seen through the lens of . The famous Schottky peak is the fingerprint of that reweighting, and its location delivers the level gap. Why: "response tracks fluctuation" is precise as an identity between functions, not as a coincidence of peak positions; the factor is a physical, not cosmetic, part of the relation.
Limiting cases
The fluctuation–response relation across regimes:
| Case | Result | Meaning |
|---|---|---|
| Thermodynamic limit | and , so relative fluctuations vanish; canonical microcanonical. | |
| Classical ideal gas | Relative fluctuation , explicitly ; at . | |
| Two-level (Schottky) | Peaks at (); the level gap is read off the peak. | |
| Low (quantum solid) | Thermal excitations are frozen out, so and consequently , consistent with the third law. | |
| Critical point | Diverging long-ranged energy fluctuations drive ; the picture breaks. |
Worked examples
1 · Reading a level gap off a Schottky peak (a real crystal-field measurement)
A dilute paramagnetic salt has a doublet of ions with a crystal-field gap such that . Where (in temperature) does the molar heat capacity peak, and how large is the peak? One mole of ions.
Step 1. Locate the peak in . The two-level heat capacity (per mole, ) peaks where , whose numerical root is .
Step 2. Convert to a temperature. Since , the peak is at .
Step 3. Compute the peak height. At , the factor , so .
Step 4. The physics. The heat capacity bump at is a direct fingerprint of the level gap — the peak arises from the finite energy gap , and measuring its position provides a direct estimate of that gap. Below the peak, thermal activation across the gap is exponentially suppressed, so . At high temperature the energy variance saturates while the factor drives back to zero, producing the characteristic Schottky maximum in between.
2 · How invisible are the energy fluctuations of a mole of gas? (exam level)
Take one mole of monatomic ideal gas at . Compute the RMS energy fluctuation and express it as a fraction of the internal energy .
Step 1. Internal energy. .
Step 2. Variance from the fluctuation–response relation. With , . Numerically , so .
Step 3. The fraction. , which equals exactly.
Step 4. The lesson. The energy of a mole of gas is defined to about one part in — a spread of a few nanojoules on top of kilojoules of energy — so that for macroscopic systems the canonical energy distribution is so narrow that it is experimentally indistinguishable from a fixed-energy (microcanonical) description. The scaling of relative energy fluctuations is the quantitative basis of canonical–microcanonical ensemble equivalence for macroscopic systems: it is why we may use the mathematically convenient canonical ensemble to compute the properties of systems that are, physically, at fixed energy.
Origins · 1 minfluctuation-dissipation theorem and how this was discovered
The fluctuation–dissipation theorem is the general statement that the way a system responds to a small external perturbation is completely determined by the spontaneous fluctuations it undergoes in thermal equilibrium — no driving required. The heat-capacity relation is its simplest and oldest instance: Einstein wrote the energy-fluctuation formula in 1904, and the same structure appeared in Johnson and Nyquist's 1928 analysis of thermal ("Johnson–Nyquist") noise in resistors, where the voltage fluctuations across a resistor at temperature fix its dissipative resistance. The general theorem was proved by Herbert Callen and Theodore Welton in 1951, and cast in its modern linear-response form by Ryogo Kubo in 1957, linking any response function to an equilibrium time-correlation of the conjugate fluctuation. The principle is one of the deepest unifying ideas in statistical physics: susceptibility is spin fluctuation, compressibility is density fluctuation, mobility is velocity fluctuation (the Einstein relation), and heat capacity is energy fluctuation. It is why we can extract macroscopic transport and response coefficients from simulations that merely watch a system fluctuate at equilibrium, and why the same that measures thermal jitter also measures the strength of dissipation.
Going further
References. Pathria & Beale, Statistical Mechanics, 3rd ed., §3.6 · Kardar, Statistical Physics of Particles, Ch. 4 · Reif, Fundamentals of Statistical and Thermal Physics, §6.5 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, Ch. 6 · Landau & Lifshitz, Statistical Physics Part 1, §112 · Callen & Welton, Phys. Rev. 83, 34 (1951) · Kubo, J. Phys. Soc. Japan 12, 570 (1957). The relation follows from and . The three equivalent routes to (definition, variance, ) are symbolically identical. Key results: the two-level Schottky peaks at (peak value ), with the variance saturating monotonically at ; the ideal-gas , variance , and relative fluctuation . Numerical instances: the crystal-field peak at with ; the mole-of-gas RMS fluctuation and fraction . Constants , , are CODATA/SI values.
Builds on: Canonical Ensemble · Canonical Partition Function · Boltzmann Factor · Thermodynamic Quantities from the Partition Function · Energy Fluctuations in the Canonical Ensemble. Leads to: Grand Canonical Ensemble · Grand Potential · Helmholtz Free Energy from the Partition Function · Particle-Number Fluctuations.
If C_V is just a fluctuation, why can I measure it with a calorimeter without ever seeing any fluctuations?
Because the two are the same number, and the calorimeter is measuring the aggregate effect of the microscopic fluctuations. When you supply heat and watch the temperature rise , you are probing exactly how easily the system's energy distribution shifts — and how easily it shifts is set by how wide it already is. A wide (large-variance) energy distribution moves a lot per unit temperature change (large ); a narrow one barely moves (small ). You never see the individual fluctuations because their relative size is , far below any calorimeter's resolution. But their collective statistical width is precisely the quantity , and tells you that measuring the response and measuring the fluctuation are two experiments returning one answer.
The energy variance of the two-level system only grows with temperature, yet C_V peaks. How can the response peak if the fluctuation doesn't?
This is the subtle and important point. The fluctuation and the response are linked by — an identity at every temperature, not a statement that they peak together. The per-ion variance (with ) rises monotonically with and saturates at once both levels are equally populated. What makes peaked is the explicit factor: it suppresses the high-temperature region where the variance is largest, and the product (variance-shape) has a single interior maximum at . So the response is the fluctuation reweighted toward lower temperature. The Schottky peak is the fingerprint of that reweighting — and it is physically real, because the is a genuine part of the fluctuation–response relation, not an artifact.
Does C_V ≥ 0 really follow with no assumptions, and does it always hold?
In the canonical ensemble it follows with essentially no assumptions: is a variance divided by a positive number, and a variance is a mean of a square, hence non-negative. So any system describable by a canonical distribution with a well-defined partition function has — thermodynamic stability is a theorem, not a postulate. Where it "fails" is where the premise fails. Systems with long-range interactions — self-gravitating star clusters, some nuclear and cluster systems — can exhibit negative microcanonical heat capacity, but they are not in a canonical state (their does not converge / the ensembles are inequivalent), so the argument simply does not apply to them. Within its proper domain — short-range interactions, a normalizable — is airtight.
How is this the same relation as magnetic susceptibility being spin fluctuations?
It is the same structure with a different conjugate pair. In every case you differentiate the partition function twice with respect to a control parameter, and the second derivative of produces a variance. For energy, the control is (temperature) and the variance is energy fluctuations, giving . For magnetization, the control is the magnetic field : — susceptibility equals magnetization fluctuations. For particle number, the control is the chemical potential : the isothermal compressibility is set by . All are instances of the fluctuation–dissipation theorem: a linear response coefficient equals an equilibrium fluctuation of the conjugate observable, divided by (times for the energy case). The recurring theme is that the same Boltzmann weight that fluctuates is the one you differentiate to get a response.
Why is C_V a good detector of phase transitions?
Because , so a peak or divergence in the heat capacity is a direct readout of anomalously large energy fluctuations. Away from a transition the energy is a sum of many nearly-independent local pieces, its variance grows only as , and is smooth and finite. At a continuous transition the correlation length diverges: distant regions become correlated, energy fluctuations turn long-ranged and super-extensive, the scaling breaks down, and — hence — diverges as . Watching is watching the fluctuation amplitude, which is why the specific heat is among the first observables computed when hunting a transition — experimentally as a -shaped anomaly, in simulation as a variance peak whose finite-size scaling gives .
Is the microcanonical heat capacity the same as the canonical one, given they compute it so differently?
In the thermodynamic limit, yes — this is ensemble equivalence, and the fluctuation relation is exactly why. Canonically, energy fluctuates and ; microcanonically, energy is fixed and comes instead from . Genuinely different objects, yet for a large short-range system they give the same , because the canonical energy distribution is a sharp Gaussian of relative width centered on the microcanonical energy. The two disagree only where fluctuations are not small — near critical points or for long-range interactions — exactly where the ensembles become inequivalent.