A blurred, noisy measurement is deblurred by Tikhonov regularisation, as in Section…

PHYSICS · Multi-part · Fermi University Physics · Mathematical Methods for Physics · Numerical and computational mathematics · Numerical and computational mathematics

Error, Chance and the Machine, Ch Linear systems, least squares and the singular value decomposition

Problem

A blurred, noisy measurement b=Ax+e\mathbf{b} = \mathsf{A}\mathbf{x} + \mathbf{e} is deblurred by Tikhonov regularisation, as in Section 2.7. The data are synthetic, so the true signal x\mathbf{x} is known. Only three singular components matter: σi=1.00, 3.00×10−2, 1.00×10−3\sigma_i = 1.00,\ 3.00\times10^{-2},\ 1.00\times10^{-3}, with true coefficients viTx=1.00, 0.500, 0.200\mathbf{v}_i^{\rm T}\mathbf{x} = 1.00,\ 0.500,\ 0.200 (arbitrary units). The noise is zero-mean and independent, and each uiTe\mathbf{u}_i^{\rm T}\mathbf{e} has variance δ2\delta^2 with δ=1.00×10−3\delta = 1.00\times10^{-3}. ((a)) The error of xλ\mathbf{x}_\lambda is a bias part plus a noise part, xλ−x=−∑i(1−fi)(viTx) vi+∑ifi uiTeσi vi.\mathbf{x}_\lambda - \mathbf{x} = -\sum_i (1-f_i)(\mathbf{v}_i^{\rm T}\mathbf{x})\,\mathbf{v}_i + \sum_i f_i\,\frac{\mathbf{u}_i^{\rm T}\mathbf{e}}{\sigma_i}\,\mathbf{v}_i. Show that its expected squared length is B(λ)+N(λ)B(\lambda) + N(\lambda) with B=∑i(1−fi)2(viTx)2,N=∑ifi2 δ2σi2,B = \sum_i (1-f_i)^2(\mathbf{v}_i^{\rm T}\mathbf{x})^2,\qquad N = \sum_i f_i^2\,\frac{\delta^2}{\sigma_i^2}, and say why no cross term appears. ((b)) Evaluate BB, NN and B+NB + N at λ=1.00×10−3\lambda = 1.00\times10^{-3}, 1.00×10−21.00\times10^{-2} and 1.00×10−11.00\times10^{-1}. Give also the relative error B+N/∥x∥2\sqrt{B+N}/\|\mathbf{x}\|_2 as a percentage, where ∥x∥22=∑i(viTx)2\|\mathbf{x}\|_2^2 = \sum_i(\mathbf{v}_i^{\rm T}\mathbf{x})^2. ((c)) Which of the three values of λ\lambda is best? At each, say which part dominates, and which singular component is responsible. ((d)) Evaluate B+NB + N at λ=5.00×10−3\lambda = 5.00\times10^{-3}. What does this show about the position of the best λ\lambda and the sharpness of the minimum? Say which quantity in part 1 a real measurement would not supply, and so why this calculation cannot be used to pick λ\lambda there.

Browse the problem library