Stochastic Thermodynamics
We take from the SM10 article stochastic-thermodynamics the continuous-trajectory framework: Sekimoto's stochastic energetics, which identifies heat as the Stratonovich integral of the bath force along a Langevin path, and Seifert's fluctuating system entropy . That article owns the overdamped-Langevin formulation and the continuous heat integral. Here we do not re-derive the Stratonovich heat; instead we rebuild the whole framework on a discrete Markov network, where thermodynamic bookkeeping becomes a sum over jumps and every statement can be checked by direct simulation. On a jump process governed by a master equation, a single trajectory is a sequence of transitions between states. Local detailed balance fixes each transition-rate ratio, , so the log-ratio of a forward jump to its reverse is the heat released to the bath divided by temperature. Summing along the path and adding the change in Seifert's system entropy gives the total trajectory entropy production — a well-defined random variable, positive on average but negative on rare trajectories. The centerpiece is the integral fluctuation theorem , which we verify by Monte-Carlo on a driven three-state ring: averaging over jump trajectories returns 1 to within a percent, and Jensen's inequality then delivers the second law . We close on the frontier hook of the field, the thermodynamic uncertainty relation , which trades precision for dissipation and is saturated by a biased Poisson walk. The jump-process view is the natural home for molecular motors, chemical-reaction networks, and single-molecule experiments.
- On a discrete Markov network, trajectory entropy production is a sum over jumps: , with each jump term equal to the bath entropy by local detailed balance.
- Local detailed balance makes the medium term — the microscopic-reversibility input that ties rates to thermodynamics.
- The integral fluctuation theorem holds for any initial condition and driving; the second law is its Jensen corollary.
- Seifert's stochastic system entropy makes a genuine trajectory quantity; on a nonequilibrium ring the steady state carries a persistent current and positive housekeeping entropy production.
- The thermodynamic uncertainty relation bounds the precision of any current by its entropy cost — the field's modern frontier.
- Key idea: On a jump process, entropy production is literally the log-ratio of a forward trajectory to its time-reverse; summing the jump-by-jump ratios (fixed by local detailed balance) plus the change in Seifert's system entropy gives a random variable that obeys the exact identity — the second law upgraded from an inequality to an equality.
On a discrete Markov network, entropy production is the log-ratio of a forward jump trajectory to its time-reverse. Local detailed balance fixes each jump's contribution to be the bath heat over ; adding the change in Seifert's system entropy gives the total . The exact integral fluctuation theorem holds arbitrarily far from equilibrium, and the second law is just Jensen's inequality applied to it.
Where this lives today
The jump-process formulation is the working language of nonequilibrium biophysics. Molecular motors — kinesin, myosin, the -ATPase — are modeled as Markov networks whose transitions consume ATP; local detailed balance turns the measured stepping rates into entropy-production estimates, and the thermodynamic uncertainty relation sets a floor on how precisely a motor can step given its dissipation. Chemical-reaction-network thermodynamics uses exactly the same ledger to bound the accuracy of biochemical clocks and sensory adaptation. On the experimental side, single-molecule pulling with optical tweezers reconstructs equilibrium free energies from irreversible work via the fluctuation theorems, and feedback-controlled "information engines" extract work from thermal noise up to the Landauer bound per bit — the second law generalized to include information.
The physical picture
Imagine a single enzyme or molecular motor hopping between a handful of conformational states, each hop coupled to a chemical reaction that releases or absorbs heat. There is no smooth trajectory to integrate — the state jumps discontinuously. Stochastic thermodynamics on a Markov network assigns a thermodynamic cost to each hop: the log-ratio of the rate for the hop to the rate for its reverse. Local detailed balance says this ratio is exactly the heat dumped into the surroundings, divided by temperature. Thermodynamics becomes a ledger with one line per jump.
The deep statement is a symmetry between a trajectory and its time-reverse. A forward jump path is more probable than the reversed path by exactly , where is the entropy it produces. Average over all forward paths and you are summing the probabilities of all reverse paths — which must total one. That is the integral fluctuation theorem, and the second law is just the observation that an average of being one forces the average of to be non-negative.
Local detailed balance is the bridge from microscopic reversibility to thermodynamics. It is not full detailed balance — that holds only in equilibrium and gives zero current — but a constraint on the rates that survives out of equilibrium. A driven ring can sustain a net circulating current with no detailed balance among populations, yet each individual transition still obeys local detailed balance, and that is what lets us read the heat off the rate ratios and keep the fluctuation theorems exact.
The core equations
We build the jump-process ledger from three ingredients: Seifert's system entropy (recalled from SM10), local detailed balance, and the path-probability ratio. Each equation is stated with the physical reading it carries.
where: — the instantaneous solution of the master equation evaluated at the realized state ; — Seifert's fluctuating trajectory entropy, whose ensemble average is the Gibbs–Shannon entropy. Recalled from the SM10 owner; here it supplies the system part of the total production. Local detailed balance ties each transition-rate ratio to the reservoir entropy, the single input that makes the ledger thermodynamically consistent.
where: — transition rate from state to at fixed protocol; — energy of state ; — entropy released to the bath in the jump, with the heat dumped. The log-rate-ratio is the medium entropy production per jump. The total trajectory entropy production sums the system change and the jump-by-jump medium terms.
where: the sum runs over every jump along the path; the second term is the total medium entropy . is a random variable — positive on average, negative on rare trajectories. The path-probability ratio identifies as the log-ratio of a forward path to its time-reverse, the origin of every fluctuation theorem.
where: — probability of the forward jump path (initial distribution times the product of forward rates); — probability of the reversed path under the reversed protocol. A path that produces more entropy is exponentially more probable than its reverse. Summing (4) over all paths gives the integral fluctuation theorem and, by Jensen, the second law.
where: — average over forward trajectories with any initial condition and any driving. The equality is exact; the inequality is the second law it contains. The thermodynamic uncertainty relation bounds any current's relative precision by its dissipation — the modern frontier of the field.
where: — any time-integrated current (displacement, particle number, cycles); — total entropy production over the observation window. A precise current is expensive: halving its relative variance at least doubles the dissipation.
This derivation constructs the total entropy production for a discrete jump process from first principles, showing that it equals the log-ratio of a forward path to its time-reverse and that its jump-by-jump structure is fixed entirely by local detailed balance. We work on a Markov network with time-dependent rates driven by a protocol , and we recall Seifert's system entropy from the SM10 owner rather than re-deriving it. The goal is a closed expression whose exponential average we can then prove is one.
Step 1. Write the forward path probability as the initial distribution times the product of transition rates along the realized jump sequence, , and the reverse path probability as under the reversed protocol. Why: a Markov trajectory is memoryless, so its probability factorizes into the starting weight and independent per-jump factors — the reverse path visits the same states in the opposite order.
Step 2. Take the log-ratio: . The first term is (Seifert), the second the sum of per-jump rate-ratios. Why: the initial/final weights carry the system entropy change; the rate ratios carry everything the bath did.
Step 3. Apply local detailed balance, equation (2): each rate ratio equals , the heat released to the medium over . Summing, the jump terms become where is the total heat absorbed by the system. Why: this is the microscopic-reversibility input — without it the rate ratios would be arbitrary and no thermodynamic interpretation would exist.
Step 4. Combine: . The total entropy production is exactly the log-ratio of forward to reverse path probability. Why: this single identity is the seed of every fluctuation theorem — detailed, integral, Jarzynski, Crooks — which differ only in what boundary condition they impose on the endpoints.
Step 5. For a nonequilibrium steady state (a driven ring), the system entropy change over a cycle vanishes but the medium term does not: the ring sustains a persistent probability current and a positive housekeeping entropy production per cycle, equal to the ring affinity . Why: detailed balance would require this affinity to vanish; a nonzero affinity is precisely what drives the steady current and the constant dissipation. *Verified symbolically and by Monte-Carlo in verify_aq-sm-stochastic-thermodynamics-sm11.py: local detailed balance gives the medium term ; the ring affinity is for a 2:1 bias and vanishes at detailed balance; the Schnakenberg integrand ; and on the driven ring.*
Go deeper · Derivation B · 1 minThe integral fluctuation theorem by trajectory reweighting
Here we prove the exact identity and extract the second law from it, using only the path-ratio result of the previous derivation. The proof is a one-line reweighting once is identified with , and it holds for any initial distribution and any driving protocol — the feature that makes it so much stronger than a near-equilibrium statement. We then verify it numerically on the driven three-state ring, where naive intuition (that only grows) coexists with the exact conservation law.
Step 1. Write the average as a sum over forward paths, . Why: the exponential average is an expectation over the forward ensemble, weighted by each path's forward probability.
Step 2. Substitute from equation (4). The factors cancel: . Why: the reweighting converts a forward average into a bare sum of reverse-path probabilities — the essential algebraic move.
Step 3. The reverse-path probabilities are normalized, , so exactly. Why: is a genuine probability distribution over the reversed trajectories; summing it must give one, independent of how far from equilibrium the driving is.
Step 4. Apply Jensen's inequality. Since is convex, , and the left side equals one, so , giving . Why: the second law is not an extra postulate — it is a mathematical consequence of the exact equality, which is why individual trajectories may have while the mean cannot.
Step 5. Verify by simulation on the driven three-state ring: Gillespie-sample jump trajectories from the stationary distribution, accumulate , and average . Why: the rare excursions, exponentially weighted, exactly compensate the typical dissipative paths — the numeric convergence to one is the tangible content of the theorem. *Verified in verify_aq-sm-stochastic-thermodynamics-sm11.py: the Monte-Carlo estimate (target 1, within 5%), on the driven ring, and the TUR product for the biased Poisson walk (saturating as the bias vanishes).*
Limiting cases
| Case | Result | Meaning |
|---|---|---|
| Detailed balance (equilibrium) | , | Every jump balanced; zero current, zero entropy production, no time-reversal asymmetry. |
| Nonequilibrium steady state | ring affinity | Persistent current, constant housekeeping dissipation even though populations are stationary. |
| Macroscopic limit | ; | Violating trajectories are exponentially rare; the deterministic second law becomes effectively strict. |
| Near equilibrium (Gaussian) | Gaussian entropy production automatically satisfies the fluctuation theorem; the relation is the fluctuation–dissipation theorem in disguise. |
Worked examples
Example 1 — medium entropy per jump on a two-state driven system (a real number).
Step 1. Take a two-state system with forward rate and backward rate at fixed protocol. Local detailed balance says the medium entropy produced in one up-jump is .
Step 2. Compute per up-jump, and for the reverse down-jump. Over one full forward cycle of a symmetric two-state loop driven at this ratio, the net medium entropy is the cycle affinity.
Step 3. On the three-state ring with each forward-to-backward ratio , the affinity per forward cycle is — the guaranteed positive entropy production driving the persistent current. At equal rates the affinity vanishes and detailed balance is restored.
Example 2 — the integral fluctuation theorem holds despite growing dissipation.
Step 1. Simulate jump trajectories on the driven ring with forward rates and backward rates , starting from the stationary distribution. For each trajectory accumulate .
Step 2. The mean entropy production is positive and grows with the number of jumps: over eight jumps, . Naively one might expect to be tiny.
Step 3. Yet the exponential average is , converging to the exact value 1. The rare trajectories with (thermal fluctuations transiently "un-producing" entropy), weighted by , exactly compensate the typical dissipative paths. This is the integral fluctuation theorem made concrete — the second law is its Jensen shadow.
Origins · 1 minudo seifert and how this was discovered
Going further
References. U. Seifert, 'Entropy production along a stochastic trajectory and an integral fluctuation theorem', Phys. Rev. Lett. 95, 040602 (2005) · U. Seifert, 'Stochastic thermodynamics, fluctuation theorems and molecular machines', Rep. Prog. Phys. 75, 126001 (2012) · K. Sekimoto, Stochastic Energetics (Springer LNP 799, 2010) · J. Schnakenberg, Rev. Mod. Phys. 48, 571 (1976) · A. C. Barato & U. Seifert, Phys. Rev. Lett. 114, 158101 (2015) · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, 2nd ed.
Provenance. The jump-process trajectory entropy, the path-ratio identity, and the integral fluctuation theorem follow Seifert (2005, 2012) and Schnakenberg (1976); the thermodynamic uncertainty relation is from Barato & Seifert (2015). The SM10 companion stochastic-thermodynamics owns Sekimoto's continuous Stratonovich heat and Seifert's continuous system entropy; this article recalls those and rebuilds the framework on a discrete Markov network. A verifier should recompute: (1) local detailed balance medium entropy ; (2) the ring affinity ( for a 2:1 bias) and its vanishing at detailed balance; (3) the Monte-Carlo integral fluctuation theorem ; (4) the TUR product on a biased Poisson walk. All checks are in verify_aq-sm-stochastic-thermodynamics-sm11.py.
Builds on: Langevin Equation and Stochastic Differential Equations · Fokker–Planck Equation · The Master Equation · Detailed Balance and Microscopic Reversibility · Markov Processes and the Markov Property Leads to: Fluctuation–Dissipation Theorem · Monte Carlo Method · Thermostats and Ensemble Control in Molecular Dynamics
How is the SM11 jump-process treatment different from the SM10 stochastic-thermodynamics article?
The SM10 article stochastic-thermodynamics owns the continuous formulation: Sekimoto's heat as a Stratonovich integral of the bath force along a Langevin path, and Seifert's continuous system entropy from the Fokker–Planck solution. This SM11 article rebuilds the same framework on a discrete Markov network, where a trajectory is a sequence of jumps and the entropy production becomes an explicit sum . The discrete view is the natural home for chemical reactions and molecular motors, and it makes the integral fluctuation theorem directly checkable by Gillespie simulation — which is exactly what the verify script does.
What is the difference between local detailed balance and ordinary detailed balance?
Ordinary detailed balance is an equilibrium property of the populations: , which forces zero net current in every transition. Local detailed balance is weaker and always holds: it constrains only the rates, , and encodes the microscopic reversibility of the system–bath coupling. A driven system violates ordinary detailed balance (it carries currents) but obeys local detailed balance at every jump, which is precisely what lets us assign a well-defined heat and keep the fluctuation theorems exact out of equilibrium.
Why does the integral fluctuation theorem hold arbitrarily far from equilibrium?
Because its proof uses only the path-ratio identity and the normalization of the reverse-path distribution — neither of which assumes small driving. Reweighting the forward average by converts it into a bare sum of reverse-path probabilities, which is one. No linearization, no near-equilibrium expansion, no restriction on the protocol speed enters. This is what distinguishes fluctuation theorems from older near-equilibrium results like the fluctuation–dissipation theorem, which they contain as a limiting case.
What exactly is Seifert's stochastic system entropy, and why is it needed?
Seifert's stochastic entropy is : you take the ensemble solution of the master (or Fokker–Planck) equation and evaluate it at the state the individual trajectory happens to occupy. Its ensemble average is the ordinary Gibbs–Shannon entropy, but as a trajectory quantity it fluctuates. It is needed because the total entropy production is the sum of the medium part (heat over temperature, from the jump rates) and the system part (the change in ); without the system term the integral fluctuation theorem would not close to exactly one for arbitrary initial conditions.
What is the thermodynamic uncertainty relation telling us physically?
It says precision is not free. For any time-integrated current — a motor's displacement, the number of catalyzed reactions, cycles of a clock — the relative variance is bounded below by the dissipation: . To make a current twice as precise (halve its relative variance) you must at least double the entropy you produce. It sets a fundamental thermodynamic cost on biological accuracy, and it is saturated by a biased Poisson process in the near-equilibrium limit, where the bound becomes an equality.
Do fluctuation theorems violate the second law when a trajectory has Σ<0?
No. The second law is a statement about the average entropy production, , and that is guaranteed by the integral fluctuation theorem via Jensen's inequality. Individual trajectories may have — a colloidal bead momentarily extracting heat to do work, say — but these are exponentially suppressed relative to their entropy-producing time-reverse, by the factor . In the macroscopic limit and such trajectories have probability , so the deterministic second law re-emerges.
How does this connect to Jarzynski and Crooks?
Jarzynski's equality and Crooks' theorem are special cases of the same path-ratio identity with particular boundary conditions. If the system starts (and the reverse ends) in equilibrium, the endpoint system-entropy terms combine into , and the total entropy production reduces to the dissipated work . The integral fluctuation theorem then becomes Jarzynski's , and the detailed version becomes Crooks' . The dedicated SM11 articles jarzynski-equality and crooks-fluctuation-theorem develop these in full.