Jarzynski Equality
We take from the jarzynski-crooks-relations article (SM10) the joint derivation of the two nonequilibrium work relations — the Jarzynski equality and its parent, the Crooks fluctuation theorem — from microscopic reversibility. That combined article owns the derivation and the statement that Jarzynski is the integral of Crooks. Here we take the Jarzynski equality as our subject and ask the questions a practitioner asks: what does the exponential average form buy you, and why is it so treacherous to estimate? The Jarzynski equality is astonishing on its face. It says the equilibrium free-energy difference between two states — a purely equilibrium quantity, fixed by two partition functions — can be extracted from measurements of work done along a process driven arbitrarily far from equilibrium, at any speed. Drive a system fast and you waste work on dissipation, so ; drive it slowly and . But the specific exponential average recovers regardless. It is the exponential weighting, and only the exponential weighting, that cancels the protocol-dependent dissipation. That same exponential is the source of the equality's practical curse. The average is dominated by rare trajectories in which dips below — transient "second-law violations" — and those events become exponentially rare as the typical dissipation grows. A naive arithmetic estimate from a finite sample systematically over-estimates (it is biased) and converges exquisitely slowly. Understanding this rare-event structure — and the bidirectional (Bennett acceptance ratio) remedy that uses the Crooks partner — is the SM11 register of the subject, and the reason the equality is powerful in principle yet delicate in the laboratory.
- The Jarzynski equality recovers an equilibrium free-energy difference from work measured along a process driven arbitrarily far from equilibrium, at any speed.
- We recall the derivation from the SM10 jarzynski-crooks-relations owner; here we own the exponential-average form and its estimator.
- The second law follows by Jensen's inequality; the gap is the mean dissipated work.
- For a Gaussian work distribution, exactly — the equality's near-equilibrium content.
- Jarzynski is the integral of Crooks: integrating over gives the exponential average (see the crooks-fluctuation-theorem article).
- The average is dominated by rare trajectories; the naive estimator is biased high and converges exponentially slowly — the practical curse.
- Key idea: the exponential weighting is a precision instrument — it cancels all protocol-dependent dissipation to leave the equilibrium invariant exactly, but it does so by up-weighting exponentially rare low-work trajectories, so the very structure that makes the equality exact makes it hard to sample.
The exponential weighting is a precision instrument: it cancels all protocol-dependent dissipation to leave the equilibrium invariant exactly, for any driving speed. But it does so by up-weighting exponentially rare low-work trajectories — the transient second-law "violations" — so the very structure that makes the equality exact is what makes a finite-sample estimate biased and slow to converge.
Where this lives today
The Jarzynski equality is a standard tool wherever free energies must be computed from driven processes. In molecular dynamics, "fast-switching" or "steered MD" simulations pull a ligand out of a binding pocket many times and average the work to estimate binding free energies, trading long equilibration for many short trajectories. In single-molecule biophysics, optical-tweezer and AFM pulling of nucleic acids and proteins uses the equality (usually via the Crooks/Bennett route) to read equilibrium unfolding free energies from irreversible pulls. The rare-event bias analysed here drives active research into optimal driving protocols and variance-reduction schemes, and the equality is the entry point to the broader stochastic-thermodynamics framework of trajectory work, heat, and entropy.
The physical picture
Drag a colloidal bead through water by moving an optical trap from A to B. Do it slowly and you barely disturb equilibrium; the work you spend equals the free-energy difference . Do it fast and viscous drag wastes extra work, so on average . Every individual pull gives a scattered work value. The Jarzynski equality says: don't average — average , and the answer is exactly , no matter how violently you pulled. Why the exponential and not the mean? Because is a Boltzmann factor for the work. Equilibrium statistical mechanics weights microstates by ; driving reshuffles the weights, but microscopic reversibility conserves the total Boltzmann measure, and is the bookkeeping device that tracks it from the initial ensemble to the final one. The mean work obeys only an inequality; the exponential average obeys an equality, because it is the physically conserved quantity.
The forward work distribution P(W). Its mean ⟨W⟩ lies to the RIGHT of the free-energy difference ΔF; the gap is the mean dissipated work W_diss. The exponential average ⟨e^(−βW)⟩ that yields e^(−βΔF) is dominated not by the bulk near ⟨W⟩ but by the shaded red far-left tail of trajectories with W below ΔF — the rare transient "second-law violations". These unsampled events are the outlier that carries the whole average, which is exactly why a finite sample is biased and slow to converge.
The equality is an exact sum rule on the work distribution: for every protocol and every speed. This is why a single equilibrium number can be pulled from messy nonequilibrium data — and why, when the far-left tail is under-sampled, the pull goes wrong.
Two estimators for the same ΔF. This article owns the left route — the Jarzynski exponential average of forward work — which is exact but dominated by the rare low-work tail and therefore biased for finite samples. The sibling crooks-fluctuation-theorem article owns the right route — the crossing of the forward and reverse work histograms at W = ΔF — which reads ΔF robustly without sampling the tail. Jarzynski is the integral of Crooks.
The core equations
The equality relates a nonequilibrium average to an equilibrium ratio of partition functions. We recall the setup from the jarzynski-crooks-relations owner: a system in a bath at inverse temperature , driven by a control parameter from to , started in equilibrium at .
where: — the inclusive thermodynamic work along a trajectory (a fluctuating quantity); — inverse temperature of the bath; — equilibrium Helmholtz free-energy difference; — average over trajectories started in equilibrium at and driven by the fixed protocol. Reading: the exponentially weighted work average equals a pure equilibrium quantity, for any driving speed. The second law is a corollary, not an assumption: apply Jensen's inequality to the convex map .
where: — mean dissipated (irreversible) work; the inequality is the Clausius statement, saturated only in the reversible (non-fluctuating) limit. Reading: on average you always spend at least ; the surplus is dissipation. Near equilibrium, or whenever the work distribution is Gaussian, the equality collapses to an exact mean–variance relation for .
where: — variance of the work; the second cumulant supplies the dissipation . Reading: the free-energy difference is the mean work minus a fluctuation correction; the wider the work distribution, the more you dissipated. This is the operational form used to correct free-energy estimates in simulation and single-molecule experiments. (Sign: is below , consistent with .) Finally, the equality is the integral of its Crooks parent — the relation that ties this article to its sibling.
where: — forward work distribution; — reverse-protocol work distribution at ; the crooks-fluctuation-theorem article owns the distribution form and the histogram-crossing readout. Reading: Jarzynski is what you get by integrating Crooks over all work values.
The goal of this derivation is to extract the operationally most useful consequence of the Jarzynski equality: when the work distribution is Gaussian — which happens near equilibrium, or by the central limit theorem when the work accumulates from many small independent contributions — the equality gives an exact, closed-form relation between the free-energy difference, the mean work, and the work variance. This is the formula practitioners actually use to correct raw work measurements, and it exhibits both the second-law inequality and the dissipation in a single line. We assume is Gaussian and evaluate the exponential average directly; nothing about the microscopic derivation (owned by SM10) is repeated.
Step 1. Take and compute the exponential average as a Gaussian moment-generating integral: . Why a Gaussian: the MGF of a normal variable is exactly , so the integral is done in closed form.
Step 2. Evaluate the integral: . Why the term appears: completing the square in the exponent shifts the mean and leaves the variance contribution — the standard Gaussian MGF.
Step 3. Impose the Jarzynski equality and take logs: . Divide by : . Why this is the dissipation correction: the fluctuation term subtracts exactly the mean dissipated work .
Step 4. Read off the second law and its saturation. Since , we have , i.e. , with equality iff (non-fluctuating work = reversible limit). Why this is Jensen: the same inequality follows generally from convexity of ; the Gaussian case makes the gap explicitly . Verified symbolically and numerically in verify_aq-sm-jarzynski-equality.py: the Gaussian (with the correct sign), the worked numbers , and the Jensen bound.
Go deeper · Derivation B · 1 minWhy the exponential average is biased: the rare-event curse
The goal here is to explain the single most important practical fact about the Jarzynski equality: although is exact, any finite-sample estimate of built from it is systematically biased, and the bias comes from the same rare low-work trajectories that make the equality work. Understanding this bias — and knowing it always over-estimates — is what separates a correct free-energy calculation from a subtly wrong one. We analyse the standard estimator and show it is biased upward, then point to the bidirectional remedy.
Step 1. The exponential average is dominated by trajectories with , because up-weights small and these lie in the far-left tail of . Why they matter so much: even though each such trajectory is rare, its weight is exponentially large, so the average hinges on adequately sampling the tail.
Step 2. With a finite sample the tail is under-represented, so under-estimates the true (it misses the biggest contributions). Why the direction is fixed: the sample mean of a positive, heavy-right-weighted quantity is biased low; missing large summands lowers it.
Step 3. Because and is decreasing, an under-estimated average makes larger than the truth: the free-energy estimate is biased high. Why this is dangerous: it looks like the process is more free-energetically costly than it is, and the bias shrinks only as fast as the tail is sampled — exponentially slowly when .
Step 4. The remedy is bidirectional. The Crooks partner (sibling article) lets forward and reverse work data be combined via the Bennett acceptance ratio, or via the histogram-crossing at , neither of which requires sampling the troublesome tail. Why this works: the crossing point is set by the bulk of both distributions, not the tails, so it is statistically robust — this is why single-molecule experiments quote Crooks/Bennett estimates, not raw Jarzynski averages. Verified in verify_aq-sm-jarzynski-equality.py: a Monte-Carlo estimator of for Gaussian work at is biased high (bias as ), confirming the upward bias and slow convergence.
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Quasistatic (reversible) | , | ; the equality becomes trivial and reversible thermodynamics is recovered. |
| Second-law (Jensen) corollary | Convexity of gives the Clausius inequality with . | |
| Gaussian / near-equilibrium | The variance supplies the exact dissipation correction; the operational estimator. | |
| Instantaneous switch | With no relaxation, work is on the initial ensemble — the Zwanzig free-energy-perturbation identity. | |
| Strong dissipation | The estimator's bias and variance explode; only bidirectional (Crooks/Bennett) methods remain reliable. |
Worked examples
Example 1 — Gaussian pull: reading ΔF from mean and variance. A single-molecule pulling experiment on an RNA hairpin is fast enough that the forward work is approximately Gaussian with mean and standard deviation . What is the free-energy difference, and how much work was dissipated?
Step 1. Use the Gaussian form . Working in units of (so and ): .
Step 2. The dissipated work is — exactly , so half the squared width in units.
Step 3. Cross-check the equality directly: , which is — the equality holds to machine precision. Naively exponentiating would have given , wrong by a factor of : the variance correction is essential.
Example 2 — The estimator curse in numbers. Suppose you estimate for the same system from fast pulls using . How biased is the answer?
Step 1. The true value is (Example 1). The average is dominated by trajectories with , which lie about one standard deviation below the mean and further into the tail.
Step 2. A Monte-Carlo study (in the verifier) gives the mean estimate over many repetitions: at pulls the estimate is biased high by ; at by ; at by ; only by is the bias negligible. The bias is always positive (over-estimates ) and shrinks slowly.
Step 3. The lesson: even for this benign Gaussian with modest dissipation (), hundreds to thousands of pulls are needed for a trustworthy Jarzynski estimate. For the required sample explodes exponentially — which is precisely why the Crooks/Bennett bidirectional method (sibling article) is the tool of choice in practice.
Origins · 1 minjarzynski equality and how this was discovered
Going further
References. Jarzynski, C., 'Nonequilibrium Equality for Free Energy Differences', Phys. Rev. Lett. 78, 2690 (1997) · Jarzynski, C., 'Equilibrium free-energy differences from nonequilibrium measurements: A master-equation approach', Phys. Rev. E 56, 5018 (1997) · Crooks, G. E., 'Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences', Phys. Rev. E 60, 2721 (1999) · Sethna, J. P., 'Statistical Mechanics: Entropy, Order Parameters, and Complexity' (2nd ed.), Oxford · Kardar, M., 'Statistical Physics of Particles', Cambridge · Liphardt, J. et al., 'Equilibrium Information from Nonequilibrium Measurements in an Experimental Test of Jarzynski's Equality', Science 296, 1832 (2002) · Seifert, U., 'Stochastic thermodynamics, fluctuation theorems and molecular machines', Rep. Prog. Phys. 75, 126001 (2012)
Provenance. Equality and its derivation follow Jarzynski PRL 78, 2690 (1997) and PRE 56, 5018 (1997); the Crooks parent from PRE 60, 2721 (1999). This article recalls the joint derivation from the SM10 jarzynski-crooks-relations owner and does not repeat it; its owned contribution is the exponential-average form, the Gaussian dissipation correction, and the estimator/rare-event analysis. A verifier should: (1) confirm the Gaussian result from the Gaussian moment-generating integral; (2) check the worked numbers ; (3) verify the Jensen second-law corollary ; (4) confirm Jarzynski as the -integral of Crooks with equal-variance Gaussians crossing at ; (5) reproduce the upward estimator bias by Monte-Carlo. Experimental context references Liphardt et al. (2002) and Collin et al. (2005). No fabricated constants beyond .
Builds on: Detailed Balance and Microscopic Reversibility · The Master Equation · Markov Processes and the Markov Property · Fokker–Planck Equation Leads to: Crooks Fluctuation Theorem · Fluctuation–Dissipation Theorem · Molecular Dynamics Simulation · Thermostats and Ensemble Control in Molecular Dynamics
How can an equilibrium quantity come out of a nonequilibrium measurement?
Because the exponential weighting is not an arbitrary average — it is a Boltzmann factor for the work. Microscopic reversibility guarantees that the total Boltzmann measure of the system is conserved as the control parameter is driven, and is precisely the bookkeeping quantity that transports that conserved measure from the initial equilibrium ensemble at to the final one at . The protocol-dependent dissipation contributes to individual work values but cancels exactly inside the exponential average, leaving only the ratio of partition functions . The full derivation is owned by the jarzynski-crooks-relations article.
What exactly is the "work" W in the equality?
It is the inclusive thermodynamic work, — the energy injected by changing the external control parameter along its protocol. This is distinct from the heat exchanged with the bath (which comes from the system's motion at fixed ), and from the "exclusive" work convention that omits boundary terms. The equality holds specifically for this ; substituting the heat, or the exclusive work, breaks it. Getting the work definition right is the single most common source of error when applying the equality to a real experiment or simulation.
Why does the estimator over-estimate ΔF rather than under-estimate it?
Because the exponential average is a positive quantity dominated by its largest terms, which come from rare low-work trajectories. A finite sample almost always misses some of those rare large summands, so the sample mean of is biased low. Since and is a decreasing function, a mean biased low produces a biased high. The direction is therefore fixed: naive Jarzynski estimates systematically report the process as more costly than it is. The bias shrinks only as the low-work tail is progressively sampled, which is exponentially slow when dissipation is large.
When is the Gaussian formula ΔF = ⟨W⟩ − βσ_W²/2 valid?
Whenever the work distribution is well-approximated by a Gaussian. This happens near equilibrium (weak, slow driving) and, more generally, whenever the total work accumulates as a sum of many small, roughly independent contributions so the central limit theorem applies (e.g. pulling a long polymer through many independent segments). For strongly driven single-barrier processes the distribution can be markedly non-Gaussian — often with a fat low-work tail — and the second-cumulant formula then under-corrects. In that regime one either includes higher cumulants or, better, switches to the bidirectional Crooks/Bennett estimator, which makes no Gaussian assumption.
Does the equality let a system extract work below ΔF and beat the second law?
No. Individual trajectories can have — these are the transient "second-law violations" that carry the exponential average — but the ensemble mean obeys exactly, by Jensen's inequality. You cannot systematically select the favourable trajectories without a measurement-and-feedback apparatus, and the thermodynamic cost of that information (Landauer's principle, information thermodynamics) exactly restores the balance. The equality quantifies how rare the sub- trajectories are — a fraction weighted by — which is precisely why they cannot be harvested for free.
What is the Bennett acceptance ratio and why is it better?
The Bennett acceptance ratio is a bidirectional estimator that combines forward and reverse work data optimally to estimate . Because the Crooks relation ties and together, the two data sets constrain jointly, and Bennett's method finds the maximum-likelihood value from both — effectively using the overlap region of the two histograms (near ) rather than the poorly-sampled tail of either. It is provably the minimum-variance estimator among a broad class and is the standard analysis for single-molecule pulling and alchemical free-energy simulations. The sibling crooks-fluctuation-theorem article develops the crossing readout on which it rests.
How does the instantaneous-switch limit connect to older free-energy methods?
If you switch the control parameter infinitely fast (), the system has no time to move, so the work is simply the energy change evaluated on the initial equilibrium ensemble. The Jarzynski equality then reads , which is exactly the Zwanzig free-energy-perturbation formula from 1954. So the venerable free-energy-perturbation method is the sudden-limit special case of the Jarzynski equality, and the finite-time equality generalises it to any driving speed — with the same rare-event sampling difficulty, now recognised as intrinsic rather than a quirk of perturbation theory.