A laser rangefinder measures a distance and the reading is stored in the binary32…
PHYSICS · Multi-part · Fermi University Physics · Mathematical Methods for Physics · Numerical and computational mathematics · Numerical and computational mathematics
Error, Chance and the Machine, Ch Rounding, backward error and the sensitivity of a computation
Problem
A laser rangefinder measures a distance L=12345.6m and the reading is stored in the binary32 (single-precision) floating-point format, for which the significand (including the implicit leading bit) has t=24 bits.
((a)) State ϵM and u for binary32.
((b)) Using the rounding model fl(L)=L(1+δ) with ∣δ∣≤u, give the bound on the absolute error committed in storing L.