PHYSICS · Multi-part · Fermi University Physics · Mathematical Methods for Physics · Fourier analysis and integral transforms · Probability, statistics and stochastic methods
Error, Chance and the Machine, Ch Estimators and the information in data
Problem
A variable X has the Laplace density f(x)=21e−∣x∣, whose characteristic function is ϕX(t)=1/(1+t2). Let X1,…,XN be independent copies and let σ2 be the variance of X.
((a)) Use the small-t expansion of ϕX to find ⟨X⟩ and σ2. Then carry the proof of the central limit theorem through for this density: show that ZN=∑iXi/(σN) has ϕZN(t)=(1+t2/2N)−N.
((b)) Show that lnϕZN(t)=−t2/2+t4/(8N)+O(N−2), and so find the limit of ϕZN(t). For N=50 and t=2, evaluate ϕZN(t) exactly, the Gaussian value e−t2/2, and the two-term estimate exp[−t2/2+t4/(8N)]. Why is the leading correction of order 1/N and not 1/N?
((c)) Now let X have the density g(x)=∣x∣−3 for ∣x∣≥1 and g(x)=0 otherwise. Show that g is normalised, that X has a finite mean, and that ⟨X2⟩ diverges. Say which step of the proof fails. It can be shown that near t=0 the characteristic function of g is ϕ(t)=1+t2ln∣t∣+O(t2). Use this to find the limit as N→∞ of the characteristic function of ∑iXi/N at a fixed t=0, and say what the result means for the distribution of ∑iXi/N.