Entropy Production in Nonequilibrium Systems

We take from the SM10 article entropy-production-irreversible (aq-sm-entropy-production-irreversible) the near-equilibrium result it owns: that the local entropy production rate is a bilinear form in thermodynamic fluxes and their conjugate forces, σ=∑iJiXi≥0\sigma=\sum_i J_iX_i\ge0, with the Onsager coefficients positive semi-definite. That article derives the flux–force structure from the local entropy balance and Gibbs relation. We recall it by name and do not re-derive it. This article owns the mesoscopic, trajectory-level face of entropy production: the probability-current form valid arbitrarily far from equilibrium. For an overdamped Fokker–Planck system, the average entropy-production rate is σ=∫J(x,t)2/(D p(x,t)) dx\sigma=\int J(x,t)^2/\big(D\,p(x,t)\big)\,\mathrm{d}x, where J=μFp−D ∂xpJ=\mu F p-D\,\partial_x p is the probability current. Because the integrand is a square divided by positive quantities, σ≥0\sigma\ge0 is manifest, and it vanishes if and only if the current is identically zero — the condition of detailed balance / thermodynamic equilibrium. The forces-and-fluxes bookkeeping of the SM10 owner is recovered by identifying JJ and XX; the new content is that a nonequilibrium steady state, which looks frozen because ∂tp=0\partial_t p=0, in fact sustains a persistent current and produces entropy at a constant, strictly positive rate. This reframing makes the difference between a state and a process explicit. In a nonequilibrium steady state (NESS) the distribution is stationary and the system's Shannon entropy is constant, S˙=0\dot S=0; yet S˙i>0\dot S_i>0 continuously, exactly balanced by export to the reservoirs, S˙i=−S˙e\dot S_i=-\dot S_e. The housekeeping entropy production of a NESS is the price of maintaining a current-carrying structure against relaxation — the thermodynamic signature of a driven, dissipative system, from a bead in a rotating optical trap to a molecular motor.

Key takeaways
  • The SM10 owner entropy-production-irreversible derives the near-equilibrium bilinear form σ=∑iJiXi≥0\sigma=\sum_i J_iX_i\ge0; we recall it and lift entropy production to the trajectory / probability-current level valid far from equilibrium.
  • For an overdamped Fokker–Planck process the average entropy-production rate is σ=∫J2/(Dp) dx≥0\sigma=\int J^2/(Dp)\,\mathrm{d}x\ge0, with probability current J=μFp−D ∂xpJ=\mu Fp-D\,\partial_x p.
  • Non-negativity is manifest: the integrand is a square over positive quantities; σ=0\sigma=0 iff J≡0J\equiv0, i.e. detailed balance / equilibrium.
  • A nonequilibrium steady state has ∂tp=0\partial_t p=0 but a persistent nonzero current, so it produces entropy at a constant positive rate — the "housekeeping" contribution.
  • In a NESS the system entropy is constant (S˙=0\dot S=0) while internal production is positive (S˙i>0\dot S_i>0): all produced entropy is exported, S˙i=−S˙e\dot S_i=-\dot S_e.
  • A Brownian particle driven around a ring by force ff has drift v=f/γv=f/\gamma and produces entropy at rate σ=fv/T=f2/(γT)>0\sigma=fv/T=f^2/(\gamma T)>0, zero only when f=0f=0.
  • Key idea: entropy production is a square of the probability current: σ=∫J2/(Dp) dx≥0\sigma=\int J^2/(Dp)\,\mathrm{d}x\ge0, positive exactly when a current circulates (broken detailed balance) and zero exactly at equilibrium.
The core insight

Entropy production, at the trajectory level, is a square of the probability current: for an overdamped Fokker–Planck system σ=∫J(x)2/(D p(x)) dx≥0\sigma=\int J(x)^2/\big(D\,p(x)\big)\,\mathrm{d}x\ge0, with J=μFp−D ∂xpJ=\mu Fp-D\,\partial_x p. It is strictly positive whenever a current circulates (a nonequilibrium steady state with broken detailed balance) and exactly zero when the current vanishes everywhere (equilibrium). The near-equilibrium forces-times-fluxes form, owned by the SM10 article, is the small-current limit of this.

Where this lives today

Trajectory entropy production is the organizing quantity of stochastic thermodynamics and the object measured in single-molecule and colloidal experiments, where optical tweezers pull DNA hairpins or drive beads through NESSs and the produced entropy is read off from work histograms. It sets the efficiency of molecular motors (kinesin, ATP synthase) via the ratio of useful output to dissipated free energy, and it is the quantity bounded from below by the thermodynamic uncertainty relation, which says a current cannot be made both precise and cheap: Var(J)/⟨J⟩2≥2kB/⟨Σ⟩\mathrm{Var}(J)/\langle J\rangle^2\ge2k_B/\langle\Sigma\rangle. In active matter and living systems, the entropy-production rate is used as a quantitative marker of how far from equilibrium a system operates — a "distance from death" for cells. The near-equilibrium forces-and-fluxes theory owned by the SM10 article remains the correct small-current limit; the current-squared form is what extends it into the strongly driven regime where life actually operates.

The physical picture

The SM10 owner tells the story near equilibrium: a temperature gradient (a force) drives a heat flux, and their product is the dissipation. Here we move to a single fluctuating degree of freedom and ask what entropy it produces along its stochastic path. The answer is that entropy production measures how asymmetric under time reversal the dynamics are: if a movie of the trajectory looks equally plausible run backward, no entropy is produced; the more lopsided forward-versus-reverse probabilities are, the more entropy is generated. The cleanest realization is a particle diffusing on a ring, driven by a constant tangential force so it circulates. The stationary density can be perfectly uniform and unchanging — the state looks dead — yet probability flows steadily around the ring like current in a wire, and each lap dumps a fixed quantum of heat to the bath. That persistent, invisible-in-the-density current is exactly what the entropy-production integral picks up.

Figure
A driven ring carries a nonzero probability current J so σ > 0 even with stationary density; at equilibrium the current vanishes and σ = 0 — entropy production tracks the current, not the density
driven NESS (broken detailed balance) J ≠ 0 σ > 0 (lap-by-lap heat) equilibrium (detailed balance) J = 0 σ = 0 (no dissipation)

Left: a driven ring carries a nonzero probability current JJ, so σ>0\sigma>0 even though the density is stationary. Right: at equilibrium the current vanishes and σ=0\sigma=0. Entropy production tracks the current, not the density.

The single most important plot is the entropy-production rate versus the drive: at zero drive the system is at equilibrium and produces nothing, and as the drive turns on the current appears and σ\sigma climbs quadratically. The nonzero-current branch is the thesis — a stationary state that nonetheless dissipates.

Figure
Punchline — entropy-production rate σ = f²∕(γkT) is a parabola through the origin; only f = 0 (equilibrium, green) gives σ = 0, every driven NESS (red) sits on the rising branch and dissipates
drive force f → σ = f²/(γkT) f = 0: equilibrium, σ = 0 NESS: J ≠ 0, σ > 0 σ grows quadratically from the equilibrium point

Punchline. The entropy-production rate of the driven ring is σ=f2/(γkBT)\sigma=f^2/(\gamma k_BT), a parabola through the origin. The equilibrium point f=0f=0 (green) is the only place σ\sigma vanishes; every driven steady state (red) sits on the rising branch and dissipates. Positivity of σ\sigma is not an inequality imposed by hand — it is the shape of a square.

The core equations

Entropy has an internal (produced) and an exchanged part; the second law is a statement only about the produced part. This decomposition, due to the founders of nonequilibrium thermodynamics, is recalled from the SM10 owner and sets the notation.

S˙=S˙i+S˙e,S˙i≥0(1)\dot S=\dot S_i+\dot S_e,\qquad \dot S_i\ge0 \qquad (1)

where: S˙\dot S — rate of change of the system's (Gibbs/Shannon) entropy; S˙e\dot S_e — entropy exchanged reversibly with reservoirs (sign-indefinite); S˙i\dot S_i — internally produced entropy, non-negative by the second law. In a steady state S˙=0\dot S=0, forcing S˙i=−S˙e>0\dot S_i=-\dot S_e>0. The overdamped dynamics we work with are a Fokker–Planck (Smoluchowski) equation for the probability density, written as a continuity equation for a probability current. The sign convention for the current is fixed here and used throughout.

∂tp=−∂xJ,J=μF p−D ∂xp(2)\partial_t p=-\partial_x J,\qquad J=\mu F\,p-D\,\partial_x p \qquad (2)

where: p(x,t)p(x,t) — probability density; J(x,t)J(x,t) — probability current; μ\mu — mobility; F(x)F(x) — applied force (may be non-conservative, e.g. a constant drive on a ring); D=μkBTD=\mu k_BT — diffusion constant (Einstein relation). The first term is drift, the second is diffusion; equilibrium is the special case J≡0J\equiv0. The central result of this article is the entropy-production rate as a functional of that current. It is manifestly non-negative because the integrand is a square divided by positive quantities.

σ=∫J(x,t)2D p(x,t) dx  ≥  0(3)\sigma=\int \frac{J(x,t)^2}{D\,p(x,t)}\,\mathrm{d}x\;\ge\;0 \qquad (3)

where: σ=S˙i/kB\sigma=\dot S_i/k_B (in units where entropy is measured in kBk_B); the integrand J2/(Dp)≥0J^2/(Dp)\ge0 pointwise; σ=0\sigma=0 iff J(x)=0J(x)=0 for all xx. Equation (3) is the Fokker–Planck realization of S˙i≥0\dot S_i\ge0, valid arbitrarily far from equilibrium. The near-equilibrium bilinear form owned by the SM10 article is recovered by reading off the flux and conjugate force. It is the small-current limit of (3), not an independent statement.

σ=∑iJiXi≥0,Ji=∑jLijXj,Lij=Lji(4)\sigma=\sum_i J_iX_i\ge0,\qquad J_i=\sum_j L_{ij}X_j,\quad L_{ij}=L_{ji} \qquad (4)

where: JiJ_i — thermodynamic flux; XiX_i — conjugate force; LijL_{ij} — Onsager coefficients (symmetric by microscopic reversibility, positive semi-definite so that σ≥0\sigma\ge0). This is recalled from entropy-production-irreversible; the current-squared form (3) is the trajectory-level generalization. The trajectory (fluctuating) definition that underlies both is the log-ratio of forward to time-reversed path probabilities — the connection to the fluctuation theorems owned by fluctuation-theorems.

Σ[γ]=kBln⁡P[γ]P[γ~],⟨Σ⟩≥0(5)\Sigma[\gamma]=k_B\ln\frac{\mathcal P[\gamma]}{\mathcal P[\tilde\gamma]},\qquad \langle\Sigma\rangle\ge0 \qquad (5)

where: γ\gamma — a forward trajectory, γ~\tilde\gamma — its time-reverse; P\mathcal P — the path measure; the ensemble average ⟨Σ⟩\langle\Sigma\rangle is the total entropy produced, non-negative and equal to kBT∫ ⁣σ dtk_BT\int\!\sigma\,\mathrm{d}t for the overdamped dynamics.

Derivation AEntropy production of a Fokker–Planck process is a square of the current

The goal is to derive Equation (3): starting from the definition of the system's Gibbs entropy and the entropy exchanged with the bath, show that the internal entropy-production rate of an overdamped Fokker–Planck system equals ∫J2/(Dp) dx\int J^2/(Dp)\,\mathrm{d}x, a manifestly non-negative quantity that vanishes exactly at detailed balance. The strategy is to differentiate the Shannon entropy, use the continuity equation to introduce the current by parts, add the heat dissipated to the bath (computed from the force times the current), and collect terms into a perfect square. We recall — but do not re-derive — the near-equilibrium forces-and-fluxes bookkeeping owned by the SM10 article.

Step 1. The system's Gibbs entropy is S=−kB∫pln⁡p dxS=-k_B\int p\ln p\,\mathrm{d}x. Differentiate: S˙=−kB∫(∂tp)(ln⁡p+1) dx\dot S=-k_B\int(\partial_t p)(\ln p+1)\,\mathrm{d}x. The +1+1 integrates against ∂tp\partial_t p to zero because ∫∂tp dx=∂t ⁣∫p=0\int\partial_t p\,\mathrm{d}x=\partial_t\!\int p=0 (normalization). So S˙=−kB∫(∂tp)ln⁡p dx\dot S=-k_B\int(\partial_t p)\ln p\,\mathrm{d}x. Why the +1+1 drops: probability conservation, exactly as in the H-theorem, kills the additive constant.

Step 2. Insert ∂tp=−∂xJ\partial_t p=-\partial_x J and integrate by parts (assuming J→0J\to0 at boundaries or periodicity on a ring): S˙=kB∫(∂xJ)ln⁡p dx=−kB∫J ∂xln⁡p dx=−kB∫J ∂xpp dx\dot S=k_B\int(\partial_x J)\ln p\,\mathrm{d}x=-k_B\int J\,\partial_x\ln p\,\mathrm{d}x=-k_B\int J\,\frac{\partial_x p}{p}\,\mathrm{d}x.

Step 3. Solve the current definition (2) for ∂xp\partial_x p: ∂xp=(μFp−J)/D\partial_x p=(\mu F p-J)/D. Substitute into Step 2: S˙=−kB∫J μFp−JDp dx=kB∫J2Dp dx−kB∫μFJD dx\dot S=-k_B\int J\,\frac{\mu Fp-J}{Dp}\,\mathrm{d}x=k_B\int\frac{J^2}{Dp}\,\mathrm{d}x-k_B\int\frac{\mu F J}{D}\,\mathrm{d}x.

Step 4. Identify the two pieces. The heat delivered to the bath per unit time is Q˙=∫F J dx\dot Q=\int F\,J\,\mathrm{d}x (force times current = mechanical power dissipated), so the entropy exported is S˙e=−Q˙/T=−∫FJ/T dx=−kB∫μFJ/D dx\dot S_e=-\dot Q/T=-\int FJ/T\,\mathrm{d}x=-k_B\int\mu FJ/D\,\mathrm{d}x (using D=μkBTD=\mu k_BT). Therefore S˙=S˙i+S˙e\dot S=\dot S_i+\dot S_e with S˙i=kB∫J2/(Dp) dx\dot S_i=k_B\int J^2/(Dp)\,\mathrm{d}x. Why the second term is exactly the bath entropy flow: μ/D=1/(kBT)\mu/D=1/(k_BT) by Einstein, so kB μFJ/D=FJ/Tk_B\,\mu FJ/D=FJ/T, the heat current over temperature — the reversible exchange with the reservoir.

Step 5. Since J2/(Dp)≥0J^2/(Dp)\ge0 pointwise (D>0D>0, p≥0p\ge0), S˙i≥0\dot S_i\ge0, with equality iff J(x)=0J(x)=0 for all xx — detailed balance. This is Equation (3), manifestly. Verified in verify_aq-sm-entropy-production.py: the current-squared integrand is non-negative, the split reproduces Q˙/T\dot Q/T, and the driven-ring case gives σ=f2/(γT)\sigma=f^2/(\gamma T).

Go deeper · Derivation B · 1 minThe driven ring: a nonequilibrium steady state with constant positive production
Derivation BThe driven ring: a nonequilibrium steady state with constant positive production

The goal is to compute the entropy-production rate of the archetypal NESS — an overdamped particle on a ring of circumference LL driven by a constant tangential force ff — and show it is strictly positive and constant, equal to the dissipated power over temperature, even though the density is uniform and stationary. The strategy is to find the stationary current from the flat density, express the drift velocity, and evaluate the current-squared integral (3), then cross-check against the mechanical dissipation fv/Tfv/T. This is the minimal model in which "the state looks dead but is dissipating" is exactly solvable.

Step 1. With a constant force ff and periodic boundary conditions, the stationary density is uniform, p(x)=1/Lp(x)=1/L, and ∂xp=0\partial_x p=0. The stationary current from (2) is then J=μf p=μf/LJ=\mu f\,p=\mu f/L, a constant — probability circulates steadily. Why uniform: a constant force on a translationally symmetric ring has no potential wells, so nothing localizes the particle; the unique stationary density is flat.

Step 2. The drift velocity is v=J/p=μfv=J/p=\mu f (equivalently v=f/γv=f/\gamma with friction γ=1/μ\gamma=1/\mu). The particle makes laps at rate v/Lv/L.

Step 3. Evaluate the entropy-production rate (3): σ=∫0LJ2Dp dx=(μf/L)2D(1/L) L=μ2f2D\sigma=\int_0^L\frac{J^2}{Dp}\,\mathrm{d}x=\frac{(\mu f/L)^2}{D(1/L)}\,L=\frac{\mu^2 f^2}{D}. Using D=μkBTD=\mu k_BT, this is σ=μf2/(kBT)=f2/(γkBT)\sigma=\mu f^2/(k_BT)=f^2/(\gamma k_BT). Multiplying by kBk_B to get S˙i\dot S_i: S˙i=f2/(γT)\dot S_i=f^2/(\gamma T) in entropy units, i.e. TS˙i=f2/γ=fvT\dot S_i=f^2/\gamma=fv, the mechanical power. Why it equals fv/Tfv/T: the drive does work at rate fvfv (all dissipated as heat, since the state is stationary and stores no energy), and Q˙/T=fv/T\dot Q/T=fv/T is the entropy exported — matched by production in steady state.

Step 4. Check the limits. At f=0f=0: J=0J=0, σ=0\sigma=0 — equilibrium, detailed balance restored. For f≠0f\ne0: σ=f2/(γkBT)>0\sigma=f^2/(\gamma k_BT)>0, quadratic in the drive, constant in time. The state is a NESS with persistent housekeeping entropy production. Verified in verify_aq-sm-entropy-production.py: σ=f2/(γkBT)\sigma=f^2/(\gamma k_BT) from both the current-squared integral and the fv/Tfv/T dissipation route agree exactly; σ(f=0)=0\sigma(f=0)=0.

Limiting cases

CaseResultMeaning
Equilibrium / detailed balanceJ≡0⇒σ=0J\equiv0\Rightarrow\sigma=0No current, no dissipation; the boundary case of the second law.
Near equilibrium (small current)σ→∑iJiXi≥0\sigma\to\sum_i J_iX_i\ge0, L⪰0L\succeq0Recovers the SM10 owner's bilinear Onsager form — recalled, not re-derived here.
Driven ring (NESS)σ=f2/(γkBT)\sigma=f^2/(\gamma k_BT), v=f/γv=f/\gammaStationary density but constant positive production; "housekeeping" dissipation.
Two-bath heat conductionS˙i=Q˙(1/Tc−1/Th)≥0\dot S_i=\dot Q(1/T_c-1/T_h)\ge0Discrete analogue; quadratic in ΔT\Delta T near equilibrium (recalled from SM10 owner).
Markov jump networkS˙i=kB2∑m,n(pmwmn−pnwnm)ln⁡pmwmnpnwnm\dot S_i=\tfrac{k_B}{2}\sum_{m,n}(p_mw_{mn}-p_nw_{nm})\ln\frac{p_mw_{mn}}{p_nw_{nm}}Schnakenberg form; the current-squared integral becomes a sum over cycle affinities.

Worked examples

Example 1 — A driven colloidal bead on a ring: entropy production and heat. A micron colloidal bead in water is held on a circular track (radius R=1 μmR=1\ \mu\mathrm{m}) and driven by a tangential optical force f=0.20 pNf=0.20\ \mathrm{pN} at T=300 KT=300\ \mathrm{K}. Its Stokes friction is γ=6πηa\gamma=6\pi\eta a with η=1.0×10−3 Pa s\eta=1.0\times10^{-3}\ \mathrm{Pa\,s} and bead radius a=0.5 μma=0.5\ \mu\mathrm{m}. Find the drift speed, the dissipated power, and the entropy-production rate.

Step 1. Friction γ=6πηa=6π(1.0×10−3)(0.5×10−6)=9.42×10−9 kg/s\gamma=6\pi\eta a=6\pi(1.0\times10^{-3})(0.5\times10^{-6})=9.42\times10^{-9}\ \mathrm{kg/s}. Drift speed v=f/γ=(0.20×10−12)/(9.42×10−9)=2.12×10−5 m/sv=f/\gamma=(0.20\times10^{-12})/(9.42\times10^{-9})=\mathbf{2.12\times10^{-5}\ m/s} (about 21 μm/s21\ \mu\mathrm{m/s}).

Step 2. Dissipated power Q˙=fv=TS˙i=(0.20×10−12)(2.12×10−5)=4.25×10−18 W\dot Q=fv=T\dot S_i=(0.20\times10^{-12})(2.12\times10^{-5})=\mathbf{4.25\times10^{-18}\ W} (all the drive work becomes heat, since the NESS stores no energy).

Step 3. Entropy-production rate S˙i=Q˙/T=(4.25×10−18)/300=1.42×10−20 W/K\dot S_i=\dot Q/T=(4.25\times10^{-18})/300=\mathbf{1.42\times10^{-20}\ W/K}. Equivalently S˙i=f2/(γT)=(0.20×10−12)2/[(9.42×10−9)(300)]=1.42×10−20 W/K\dot S_i=f^2/(\gamma T)=(0.20\times10^{-12})^2/[(9.42\times10^{-9})(300)]=1.42\times10^{-20}\ \mathrm{W/K} — the two routes agree.

Step 4. In kBk_B units, S˙i/kB=1.42×10−20/(1.381×10−23)=1.03×103 s−1\dot S_i/k_B=1.42\times10^{-20}/(1.381\times10^{-23})=\mathbf{1.03\times10^{3}\ s^{-1}}: the bead produces about a thousand kBk_B of entropy per second. Setting f=0f=0 makes all of these zero — equilibrium. All numbers recomputed in the verify script.

Example 2 — Two-reservoir heat conduction: quadratic production near equilibrium. A rod conducts heat between baths at Th=310 KT_h=310\ \mathrm{K} and Tc=290 KT_c=290\ \mathrm{K} with thermal conductance κ=2.0×10−3 W/K\kappa=2.0\times10^{-3}\ \mathrm{W/K}. Find the entropy-production rate and show it is quadratic in ΔT\Delta T.

Step 1. Heat current Q˙=κΔT=2.0×10−3×20=0.040 W\dot Q=\kappa\Delta T=2.0\times10^{-3}\times20=\mathbf{0.040\ W} flowing hot to cold.

Step 2. Entropy production S˙i=Q˙(1/Tc−1/Th)=0.040(1/290−1/310)=0.040×2.225×10−4=8.90×10−6 W/K\dot S_i=\dot Q(1/T_c-1/T_h)=0.040\big(1/290-1/310\big)=0.040\times2.225\times10^{-4}=\mathbf{8.90\times10^{-6}\ W/K}.

Step 3. Rewrite: S˙i=κΔT⋅ΔT/(ThTc)=κ(ΔT)2/(ThTc)=2.0×10−3(20)2/(310×290)=0.80/89900=8.90×10−6 W/K\dot S_i=\kappa\Delta T\cdot\Delta T/(T_hT_c)=\kappa(\Delta T)^2/(T_hT_c)=2.0\times10^{-3}(20)^2/(310\times290)=0.80/89900=\mathbf{8.90\times10^{-6}\ W/K} — matches Step 2, and is manifestly ∝(ΔT)2\propto(\Delta T)^2, the linear-response (Onsager) signature.

Step 4. In the equilibrium limit ΔT→0\Delta T\to0, S˙i→0\dot S_i\to0 quadratically; the flux–force pair is J=Q˙J=\dot Q, X=1/Tc−1/ThX=1/T_c-1/T_h, recovering the SM10 owner's bilinear σ=JX\sigma=JX. Recomputed in the verify script.

Origins · 1 minentropy production and how this was discovered
EP
entropy production
nonequilibrium thermodynamics, 20th c. · The rate of irreversible entropy generation

"Entropy production" is the central quantity of irreversible thermodynamics, given its modern local form by Théophile De Donder (affinities, 1920s), Lars Onsager (reciprocal relations, 1931), Ilya Prigogine (minimum-entropy-production theorem and dissipative structures, Nobel 1977), and S. R. de Groot and P. Mazur (the definitive continuum formulation, 1962). Jürgen Schnakenberg (1976) recast it for stochastic networks, and Christian Van den Broeck, Udo Seifert, and collaborators built the trajectory-level (stochastic) theory in which entropy production is the log-ratio of forward to reverse path probabilities. The through-line from Clausius to stochastic thermodynamics is that entropy production is not merely non-negative on average but obeys exact fluctuation-theorem symmetries far from equilibrium.

History
1854
— Clausius formulates the inequality that anticipates diS≥0\mathrm{d}_iS\ge0
1911
— De Donder introduces chemical affinity as the force conjugate to reaction rate
1931
— Onsager proves the reciprocal relations for the linear coefficients
1947
— Prigogine states the minimum-entropy-production theorem for the linear regime
1962
— De Groot and Mazur publish the definitive continuum theory of entropy production
1976
— Schnakenberg gives the network (Markov-jump) entropy-production formula
1977
— Prigogine receives the Nobel Prize for dissipative structures
2005
— Seifert formulates trajectory-level (stochastic) entropy production with an integral fluctuation theorem

Going further

References. De Groot & Mazur, Non-Equilibrium Thermodynamics (Dover, 1984), Ch. III · Seifert, "Stochastic thermodynamics, fluctuation theorems and molecular machines," Rep. Prog. Phys. 75, 126001 (2012) · Schnakenberg, "Network theory of microscopic and macroscopic behavior of master equation systems," Rev. Mod. Phys. 48, 571 (1976) · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, 2nd ed. · Reif, Fundamentals of Statistical and Thermal Physics, Ch. 15 · Barato & Seifert, "Thermodynamic uncertainty relation for biomolecular processes," Phys. Rev. Lett. 114, 158101 (2015)

Provenance. The near-equilibrium bilinear form σ=∑iJiXi≥0\sigma=\sum_iJ_iX_i\ge0 with symmetric positive-semidefinite Onsager matrix is derived and owned by the SM10 article entropy-production-irreversible (aq-sm-entropy-production-irreversible); it is recalled here by name. This article's structural result is the probability-current form σ=∫J2/(Dp) dx≥0\sigma=\int J^2/(Dp)\,\mathrm{d}x\ge0 for overdamped Fokker–Planck dynamics (Seifert 2012, Rep. Prog. Phys. 75, 126001) and the driven-ring NESS σ=f2/(γkBT)\sigma=f^2/(\gamma k_BT). A verifier should: (1) reproduce the current-squared derivation and the Q˙/T\dot Q/T export term via the Einstein relation D=μkBTD=\mu k_BT; (2) evaluate the driven ring both by the integral (3) and by fv/Tfv/T and confirm agreement; (3) check the two-reservoir S˙i=κ(ΔT)2/(ThTc)\dot S_i=\kappa(\Delta T)^2/(T_hT_c) quadratic form; (4) confirm σ=0\sigma=0 iff J≡0J\equiv0. Numerical worked-example values are recomputed in verify_aq-sm-entropy-production.py.

Builds on: The Master Equation · Detailed Balance and Microscopic Reversibility · Fokker–Planck Equation · Markov Processes and the Markov Property Leads to: Fluctuation–Dissipation Theorem · Langevin Equation and Stochastic Differential Equations · Thermostats and Ensemble Control in Molecular Dynamics

How is this article's entropy production different from the SM10 one it recalls?

The SM10 article entropy-production-irreversible owns the near-equilibrium picture: entropy production as a bilinear form σ=∑iJiXi\sigma=\sum_i J_iX_i in thermodynamic fluxes and their conjugate forces, valid when fluxes are linear in forces (the Onsager regime). This article owns the trajectory / probability-current form σ=∫J2/(Dp) dx\sigma=\int J^2/(Dp)\,\mathrm{d}x, which holds arbitrarily far from equilibrium and does not assume linear response. The two are consistent: expanding the current-squared form for small currents reproduces the bilinear form. Think of the SM10 result as the leading term and this one as the full expression — the mesoscopic, exact-in-driving statement.

Why does a stationary state produce entropy at all — nothing is changing?

The confusion is between a state function and a process rate. In a nonequilibrium steady state the distribution is stationary, so the system's own Gibbs entropy is constant: S˙=0\dot S=0. But entropy production is not a change in a state function — it is the rate at which irreversibility is generated by the ongoing dynamics. A driven ring circulates probability steadily; each lap dissipates a fixed quantum of heat to the bath. That heat carries entropy Q˙/T\dot Q/T out of the system, and to keep the system's entropy constant, exactly that much must be produced internally: S˙i=−S˙e>0\dot S_i=-\dot S_e>0. The state is frozen; the process is not.

What role does the Einstein relation D=μkBTD=\mu k_BT play in the derivation?

It is what makes the two pieces of S˙\dot S separate cleanly into production and exchange. When you substitute the current definition into the entropy rate, one term is the current-squared production kB∫J2/(Dp) dxk_B\int J^2/(Dp)\,\mathrm{d}x and the other is −kB∫μFJ/D dx-k_B\int\mu FJ/D\,\mathrm{d}x. Using μ/D=1/(kBT)\mu/D=1/(k_BT) (the Einstein relation), that second term becomes exactly −∫FJ/T dx=−Q˙/T=S˙e-\int FJ/T\,\mathrm{d}x=-\dot Q/T=\dot S_e, the entropy exported to the bath at temperature TT. Without the fluctuation–dissipation link between mobility and diffusion, the second term would not be a thermodynamically meaningful heat flow. The Einstein relation is the bridge between the mechanical (drift) and thermal (diffusion) faces of the dynamics.

Can individual trajectories have negative entropy production?

Yes. The average entropy production is non-negative, ⟨Σ⟩≥0\langle\Sigma\rangle\ge0, but a single fluctuating trajectory can transiently have Σ<0\Sigma<0 — a momentary "second-law violation" in which the system extracts order from thermal noise. These events are not forbidden; they are merely exponentially rare, quantified precisely by the detailed fluctuation theorem P(+Σ)/P(−Σ)=eΣ/kBP(+\Sigma)/P(-\Sigma)=e^{\Sigma/k_B} owned by the fluctuation-theorem articles. The current-squared form σ=∫J2/(Dp) dx\sigma=\int J^2/(Dp)\,\mathrm{d}x is the ensemble-averaged rate; it is non-negative because the average washes out the rare negative excursions.

How does entropy production show up in a Markov jump network instead of a continuous coordinate?

For a jump process with rates wmnw_{mn}, the probability current on the edge m→nm\to n is jmn=pmwmn−pnwnmj_{mn}=p_mw_{mn}-p_nw_{nm}, and the entropy-production rate is the Schnakenberg formula S˙i=kB2∑m,n(pmwmn−pnwnm)ln⁡pmwmnpnwnm≥0\dot S_i=\tfrac{k_B}{2}\sum_{m,n}(p_mw_{mn}-p_nw_{nm})\ln\frac{p_mw_{mn}}{p_nw_{nm}}\ge0. Each term is (x−y)ln⁡(x/y)≥0(x-y)\ln(x/y)\ge0, so the whole sum is non-negative, vanishing iff detailed balance pmwmn=pnwnmp_mw_{mn}=p_nw_{nm} holds on every edge. This is the discrete analogue of the current-squared integral: the continuous J2/(Dp)J^2/(Dp) becomes a sum over edge currents times their affinities. Molecular motors are analyzed exactly this way.

Is minimum entropy production a general principle?

Only near equilibrium. Prigogine's minimum-entropy-production theorem states that in the linear (Onsager) regime, a nonequilibrium steady state minimizes the total entropy-production rate subject to the imposed constraints. It is a genuine variational principle there. But it does not extend to the far-from-equilibrium regime: driven systems can and do settle into states that are not minimum-dissipation, and no simple extremal principle governs the general NESS. This is one reason the trajectory-level, current-squared formulation matters — it gives an exact expression for σ\sigma without relying on any variational shortcut that only holds close to equilibrium.

Why is entropy production called the "arrow of time made quantitative"?

Because it equals the average log-likelihood ratio for telling forward from backward. If you watch a movie of the dynamics and try to guess whether it runs forward or in reverse, your best statistical evidence per trajectory is exactly Σ=kBln⁡(P[γ]/P[γ~])\Sigma=k_B\ln(\mathcal P[\gamma]/\mathcal P[\tilde\gamma]). A reversible process (Σ=0\Sigma=0) is one where forward and reverse are equally likely — you cannot tell the direction of time. The more entropy produced, the more lopsided the forward/reverse probabilities and the more confidently you can read the arrow. This information-theoretic identity is why entropy production, time-reversal asymmetry, and irreversibility are three names for the same thing.

Before this

Where this leads