PHYSICS · Multi-part · Fermi University Physics · Mathematical Methods for Physics · Thermal, Statistical & Complex Systems · Non-equilibrium statistical mechanics and stochastic thermodynamics
Error, Chance and the Machine, Ch Random walks and Markov chains
Problem
A three-level vibrational system has energies E1=0, E2=kBT and E3=3kBT, measured in units of the thermal energy kBT. Once every observation interval the system may hop to an adjacent level only (there is no direct 1↔3 transition). The upward hop probabilities are fixed by the experiment at P12=P23=α=0.10; detailed balance with the Boltzmann distribution at temperature T then fixes the downward hop probabilities, Pi+1,i=αe(Ei+1−Ei)/kBT. Any interval in which no hop is attempted leaves the system in its current level (a self-loop).
((a)) Write out the full 3×3 transition matrix P.
((b)) Find the stationary distribution π from the Boltzmann weights πi∝e−Ei/kBT, and confirm that it satisfies detailed balance, πiPij=πjPji, for both pairs of neighbouring levels.
((c)) For a reversible chain the symmetrised matrix S=D1/2PD−1/2, with D=diag(π), is symmetric. Show this for P above and explain why it forces every eigenvalue of P to be real.
((d)) State whether the chain is irreducible and aperiodic, and hence whether it settles to π from any starting distribution.