A discrete-time Markov chain (Chapter 8) models a molecule hopping between three…

PHYSICS · Multi-part · Fermi University Physics · Mathematical Methods for Physics · Thermal, Statistical & Complex Systems · Non-equilibrium statistical mechanics and stochastic thermodynamics

Error, Chance and the Machine, Ch Random processes in continuous time

Problem

A discrete-time Markov chain (Chapter 8) models a molecule hopping between three conformations 11, 22, 33 once every Δt=1 μs\Delta t = 1\,\mu{\rm s}, with stationary distribution π=(0.5, 0.3, 0.2)\boldsymbol\pi = (0.5,\ 0.3,\ 0.2) satisfying detailed balance πiPij=πjPji\pi_i P_{ij} = \pi_j P_{ji}. The forward one-step probabilities are P12=0.02P_{12} = 0.02, P13=0.01P_{13} = 0.01 and P23=0.015P_{23} = 0.015. ((a)) Use detailed balance to find P21P_{21}, P31P_{31} and P32P_{32}. ((b)) Taking the continuous-time master equation's rates as Wmn=Pmn/ΔtW_{mn} = P_{mn}/\Delta t for m≠nm\ne n, write the generator's three diagonal entries G11G_{11}, G22G_{22}, G33G_{33} (in s−1{\rm s^{-1}}), using the convention that every row of the generator sums to zero. ((c)) Confirm that πG=0\boldsymbol\pi\mathsf{G} = 0, the equilibrium condition of the master equation. ((d)) Treat πi∝e−Ei/kBT\pi_i \propto e^{-E_i/k_{\rm B}T} as an effective Boltzmann weight at T=300 KT = 300\,{\rm K}, the discrete analogue of the stationary solution of the Fokker-Planck equation for a particle in a potential. Find the energy differences E2−E1E_2 - E_1 and E3−E1E_3 - E_1.

Browse the problem library