Entropy Production in Nonequilibrium Systems
We take from the SM10 article entropy-production-irreversible (aq-sm-entropy-production-irreversible) the near-equilibrium result it owns: that the local entropy production rate is a bilinear form in thermodynamic fluxes and their conjugate forces, , with the Onsager coefficients positive semi-definite. That article derives the flux–force structure from the local entropy balance and Gibbs relation. We recall it by name and do not re-derive it. This article owns the mesoscopic, trajectory-level face of entropy production: the probability-current form valid arbitrarily far from equilibrium. For an overdamped Fokker–Planck system, the average entropy-production rate is , where is the probability current. Because the integrand is a square divided by positive quantities, is manifest, and it vanishes if and only if the current is identically zero — the condition of detailed balance / thermodynamic equilibrium. The forces-and-fluxes bookkeeping of the SM10 owner is recovered by identifying and ; the new content is that a nonequilibrium steady state, which looks frozen because , in fact sustains a persistent current and produces entropy at a constant, strictly positive rate. This reframing makes the difference between a state and a process explicit. In a nonequilibrium steady state (NESS) the distribution is stationary and the system's Shannon entropy is constant, ; yet continuously, exactly balanced by export to the reservoirs, . The housekeeping entropy production of a NESS is the price of maintaining a current-carrying structure against relaxation — the thermodynamic signature of a driven, dissipative system, from a bead in a rotating optical trap to a molecular motor.
- The SM10 owner entropy-production-irreversible derives the near-equilibrium bilinear form ; we recall it and lift entropy production to the trajectory / probability-current level valid far from equilibrium.
- For an overdamped Fokker–Planck process the average entropy-production rate is , with probability current .
- Non-negativity is manifest: the integrand is a square over positive quantities; iff , i.e. detailed balance / equilibrium.
- A nonequilibrium steady state has but a persistent nonzero current, so it produces entropy at a constant positive rate — the "housekeeping" contribution.
- In a NESS the system entropy is constant () while internal production is positive (): all produced entropy is exported, .
- A Brownian particle driven around a ring by force has drift and produces entropy at rate , zero only when .
- Key idea: entropy production is a square of the probability current: , positive exactly when a current circulates (broken detailed balance) and zero exactly at equilibrium.
Entropy production, at the trajectory level, is a square of the probability current: for an overdamped Fokker–Planck system , with . It is strictly positive whenever a current circulates (a nonequilibrium steady state with broken detailed balance) and exactly zero when the current vanishes everywhere (equilibrium). The near-equilibrium forces-times-fluxes form, owned by the SM10 article, is the small-current limit of this.
Where this lives today
Trajectory entropy production is the organizing quantity of stochastic thermodynamics and the object measured in single-molecule and colloidal experiments, where optical tweezers pull DNA hairpins or drive beads through NESSs and the produced entropy is read off from work histograms. It sets the efficiency of molecular motors (kinesin, ATP synthase) via the ratio of useful output to dissipated free energy, and it is the quantity bounded from below by the thermodynamic uncertainty relation, which says a current cannot be made both precise and cheap: . In active matter and living systems, the entropy-production rate is used as a quantitative marker of how far from equilibrium a system operates — a "distance from death" for cells. The near-equilibrium forces-and-fluxes theory owned by the SM10 article remains the correct small-current limit; the current-squared form is what extends it into the strongly driven regime where life actually operates.
The physical picture
The SM10 owner tells the story near equilibrium: a temperature gradient (a force) drives a heat flux, and their product is the dissipation. Here we move to a single fluctuating degree of freedom and ask what entropy it produces along its stochastic path. The answer is that entropy production measures how asymmetric under time reversal the dynamics are: if a movie of the trajectory looks equally plausible run backward, no entropy is produced; the more lopsided forward-versus-reverse probabilities are, the more entropy is generated. The cleanest realization is a particle diffusing on a ring, driven by a constant tangential force so it circulates. The stationary density can be perfectly uniform and unchanging — the state looks dead — yet probability flows steadily around the ring like current in a wire, and each lap dumps a fixed quantum of heat to the bath. That persistent, invisible-in-the-density current is exactly what the entropy-production integral picks up.
Left: a driven ring carries a nonzero probability current , so even though the density is stationary. Right: at equilibrium the current vanishes and . Entropy production tracks the current, not the density.
The single most important plot is the entropy-production rate versus the drive: at zero drive the system is at equilibrium and produces nothing, and as the drive turns on the current appears and climbs quadratically. The nonzero-current branch is the thesis — a stationary state that nonetheless dissipates.
Punchline. The entropy-production rate of the driven ring is , a parabola through the origin. The equilibrium point (green) is the only place vanishes; every driven steady state (red) sits on the rising branch and dissipates. Positivity of is not an inequality imposed by hand — it is the shape of a square.
The core equations
Entropy has an internal (produced) and an exchanged part; the second law is a statement only about the produced part. This decomposition, due to the founders of nonequilibrium thermodynamics, is recalled from the SM10 owner and sets the notation.
where: — rate of change of the system's (Gibbs/Shannon) entropy; — entropy exchanged reversibly with reservoirs (sign-indefinite); — internally produced entropy, non-negative by the second law. In a steady state , forcing . The overdamped dynamics we work with are a Fokker–Planck (Smoluchowski) equation for the probability density, written as a continuity equation for a probability current. The sign convention for the current is fixed here and used throughout.
where: — probability density; — probability current; — mobility; — applied force (may be non-conservative, e.g. a constant drive on a ring); — diffusion constant (Einstein relation). The first term is drift, the second is diffusion; equilibrium is the special case . The central result of this article is the entropy-production rate as a functional of that current. It is manifestly non-negative because the integrand is a square divided by positive quantities.
where: (in units where entropy is measured in ); the integrand pointwise; iff for all . Equation (3) is the Fokker–Planck realization of , valid arbitrarily far from equilibrium. The near-equilibrium bilinear form owned by the SM10 article is recovered by reading off the flux and conjugate force. It is the small-current limit of (3), not an independent statement.
where: — thermodynamic flux; — conjugate force; — Onsager coefficients (symmetric by microscopic reversibility, positive semi-definite so that ). This is recalled from entropy-production-irreversible; the current-squared form (3) is the trajectory-level generalization. The trajectory (fluctuating) definition that underlies both is the log-ratio of forward to time-reversed path probabilities — the connection to the fluctuation theorems owned by fluctuation-theorems.
where: — a forward trajectory, — its time-reverse; — the path measure; the ensemble average is the total entropy produced, non-negative and equal to for the overdamped dynamics.
The goal is to derive Equation (3): starting from the definition of the system's Gibbs entropy and the entropy exchanged with the bath, show that the internal entropy-production rate of an overdamped Fokker–Planck system equals , a manifestly non-negative quantity that vanishes exactly at detailed balance. The strategy is to differentiate the Shannon entropy, use the continuity equation to introduce the current by parts, add the heat dissipated to the bath (computed from the force times the current), and collect terms into a perfect square. We recall — but do not re-derive — the near-equilibrium forces-and-fluxes bookkeeping owned by the SM10 article.
Step 1. The system's Gibbs entropy is . Differentiate: . The integrates against to zero because (normalization). So . Why the drops: probability conservation, exactly as in the H-theorem, kills the additive constant.
Step 2. Insert and integrate by parts (assuming at boundaries or periodicity on a ring): .
Step 3. Solve the current definition (2) for : . Substitute into Step 2: .
Step 4. Identify the two pieces. The heat delivered to the bath per unit time is (force times current = mechanical power dissipated), so the entropy exported is (using ). Therefore with . Why the second term is exactly the bath entropy flow: by Einstein, so , the heat current over temperature — the reversible exchange with the reservoir.
Step 5. Since pointwise (, ), , with equality iff for all — detailed balance. This is Equation (3), manifestly. Verified in verify_aq-sm-entropy-production.py: the current-squared integrand is non-negative, the split reproduces , and the driven-ring case gives .
Go deeper · Derivation B · 1 minThe driven ring: a nonequilibrium steady state with constant positive production
The goal is to compute the entropy-production rate of the archetypal NESS — an overdamped particle on a ring of circumference driven by a constant tangential force — and show it is strictly positive and constant, equal to the dissipated power over temperature, even though the density is uniform and stationary. The strategy is to find the stationary current from the flat density, express the drift velocity, and evaluate the current-squared integral (3), then cross-check against the mechanical dissipation . This is the minimal model in which "the state looks dead but is dissipating" is exactly solvable.
Step 1. With a constant force and periodic boundary conditions, the stationary density is uniform, , and . The stationary current from (2) is then , a constant — probability circulates steadily. Why uniform: a constant force on a translationally symmetric ring has no potential wells, so nothing localizes the particle; the unique stationary density is flat.
Step 2. The drift velocity is (equivalently with friction ). The particle makes laps at rate .
Step 3. Evaluate the entropy-production rate (3): . Using , this is . Multiplying by to get : in entropy units, i.e. , the mechanical power. Why it equals : the drive does work at rate (all dissipated as heat, since the state is stationary and stores no energy), and is the entropy exported — matched by production in steady state.
Step 4. Check the limits. At : , — equilibrium, detailed balance restored. For : , quadratic in the drive, constant in time. The state is a NESS with persistent housekeeping entropy production. Verified in verify_aq-sm-entropy-production.py: from both the current-squared integral and the dissipation route agree exactly; .
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Equilibrium / detailed balance | No current, no dissipation; the boundary case of the second law. | |
| Near equilibrium (small current) | , | Recovers the SM10 owner's bilinear Onsager form — recalled, not re-derived here. |
| Driven ring (NESS) | , | Stationary density but constant positive production; "housekeeping" dissipation. |
| Two-bath heat conduction | Discrete analogue; quadratic in near equilibrium (recalled from SM10 owner). | |
| Markov jump network | Schnakenberg form; the current-squared integral becomes a sum over cycle affinities. |
Worked examples
Example 1 — A driven colloidal bead on a ring: entropy production and heat. A micron colloidal bead in water is held on a circular track (radius ) and driven by a tangential optical force at . Its Stokes friction is with and bead radius . Find the drift speed, the dissipated power, and the entropy-production rate.
Step 1. Friction . Drift speed (about ).
Step 2. Dissipated power (all the drive work becomes heat, since the NESS stores no energy).
Step 3. Entropy-production rate . Equivalently — the two routes agree.
Step 4. In units, : the bead produces about a thousand of entropy per second. Setting makes all of these zero — equilibrium. All numbers recomputed in the verify script.
Example 2 — Two-reservoir heat conduction: quadratic production near equilibrium. A rod conducts heat between baths at and with thermal conductance . Find the entropy-production rate and show it is quadratic in .
Step 1. Heat current flowing hot to cold.
Step 2. Entropy production .
Step 3. Rewrite: — matches Step 2, and is manifestly , the linear-response (Onsager) signature.
Step 4. In the equilibrium limit , quadratically; the flux–force pair is , , recovering the SM10 owner's bilinear . Recomputed in the verify script.
Origins · 1 minentropy production and how this was discovered
"Entropy production" is the central quantity of irreversible thermodynamics, given its modern local form by Théophile De Donder (affinities, 1920s), Lars Onsager (reciprocal relations, 1931), Ilya Prigogine (minimum-entropy-production theorem and dissipative structures, Nobel 1977), and S. R. de Groot and P. Mazur (the definitive continuum formulation, 1962). Jürgen Schnakenberg (1976) recast it for stochastic networks, and Christian Van den Broeck, Udo Seifert, and collaborators built the trajectory-level (stochastic) theory in which entropy production is the log-ratio of forward to reverse path probabilities. The through-line from Clausius to stochastic thermodynamics is that entropy production is not merely non-negative on average but obeys exact fluctuation-theorem symmetries far from equilibrium.
Going further
References. De Groot & Mazur, Non-Equilibrium Thermodynamics (Dover, 1984), Ch. III · Seifert, "Stochastic thermodynamics, fluctuation theorems and molecular machines," Rep. Prog. Phys. 75, 126001 (2012) · Schnakenberg, "Network theory of microscopic and macroscopic behavior of master equation systems," Rev. Mod. Phys. 48, 571 (1976) · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, 2nd ed. · Reif, Fundamentals of Statistical and Thermal Physics, Ch. 15 · Barato & Seifert, "Thermodynamic uncertainty relation for biomolecular processes," Phys. Rev. Lett. 114, 158101 (2015)
Provenance. The near-equilibrium bilinear form with symmetric positive-semidefinite Onsager matrix is derived and owned by the SM10 article entropy-production-irreversible (aq-sm-entropy-production-irreversible); it is recalled here by name. This article's structural result is the probability-current form for overdamped Fokker–Planck dynamics (Seifert 2012, Rep. Prog. Phys. 75, 126001) and the driven-ring NESS . A verifier should: (1) reproduce the current-squared derivation and the export term via the Einstein relation ; (2) evaluate the driven ring both by the integral (3) and by and confirm agreement; (3) check the two-reservoir quadratic form; (4) confirm iff . Numerical worked-example values are recomputed in verify_aq-sm-entropy-production.py.
Builds on: The Master Equation · Detailed Balance and Microscopic Reversibility · Fokker–Planck Equation · Markov Processes and the Markov Property Leads to: Fluctuation–Dissipation Theorem · Langevin Equation and Stochastic Differential Equations · Thermostats and Ensemble Control in Molecular Dynamics
How is this article's entropy production different from the SM10 one it recalls?
The SM10 article entropy-production-irreversible owns the near-equilibrium picture: entropy production as a bilinear form in thermodynamic fluxes and their conjugate forces, valid when fluxes are linear in forces (the Onsager regime). This article owns the trajectory / probability-current form , which holds arbitrarily far from equilibrium and does not assume linear response. The two are consistent: expanding the current-squared form for small currents reproduces the bilinear form. Think of the SM10 result as the leading term and this one as the full expression — the mesoscopic, exact-in-driving statement.
Why does a stationary state produce entropy at all — nothing is changing?
The confusion is between a state function and a process rate. In a nonequilibrium steady state the distribution is stationary, so the system's own Gibbs entropy is constant: . But entropy production is not a change in a state function — it is the rate at which irreversibility is generated by the ongoing dynamics. A driven ring circulates probability steadily; each lap dissipates a fixed quantum of heat to the bath. That heat carries entropy out of the system, and to keep the system's entropy constant, exactly that much must be produced internally: . The state is frozen; the process is not.
What role does the Einstein relation play in the derivation?
It is what makes the two pieces of separate cleanly into production and exchange. When you substitute the current definition into the entropy rate, one term is the current-squared production and the other is . Using (the Einstein relation), that second term becomes exactly , the entropy exported to the bath at temperature . Without the fluctuation–dissipation link between mobility and diffusion, the second term would not be a thermodynamically meaningful heat flow. The Einstein relation is the bridge between the mechanical (drift) and thermal (diffusion) faces of the dynamics.
Can individual trajectories have negative entropy production?
Yes. The average entropy production is non-negative, , but a single fluctuating trajectory can transiently have — a momentary "second-law violation" in which the system extracts order from thermal noise. These events are not forbidden; they are merely exponentially rare, quantified precisely by the detailed fluctuation theorem owned by the fluctuation-theorem articles. The current-squared form is the ensemble-averaged rate; it is non-negative because the average washes out the rare negative excursions.
How does entropy production show up in a Markov jump network instead of a continuous coordinate?
For a jump process with rates , the probability current on the edge is , and the entropy-production rate is the Schnakenberg formula . Each term is , so the whole sum is non-negative, vanishing iff detailed balance holds on every edge. This is the discrete analogue of the current-squared integral: the continuous becomes a sum over edge currents times their affinities. Molecular motors are analyzed exactly this way.
Is minimum entropy production a general principle?
Only near equilibrium. Prigogine's minimum-entropy-production theorem states that in the linear (Onsager) regime, a nonequilibrium steady state minimizes the total entropy-production rate subject to the imposed constraints. It is a genuine variational principle there. But it does not extend to the far-from-equilibrium regime: driven systems can and do settle into states that are not minimum-dissipation, and no simple extremal principle governs the general NESS. This is one reason the trajectory-level, current-squared formulation matters — it gives an exact expression for without relying on any variational shortcut that only holds close to equilibrium.
Why is entropy production called the "arrow of time made quantitative"?
Because it equals the average log-likelihood ratio for telling forward from backward. If you watch a movie of the dynamics and try to guess whether it runs forward or in reverse, your best statistical evidence per trajectory is exactly . A reversible process () is one where forward and reverse are equally likely — you cannot tell the direction of time. The more entropy produced, the more lopsided the forward/reverse probabilities and the more confidently you can read the arrow. This information-theoretic identity is why entropy production, time-reversal asymmetry, and irreversibility are three names for the same thing.