Laplace's Method for Integrals
Reach for almost any integral in physics that carries a large parameter — an action in units of , a temperature written as an inverse , a particle number — and it tends to arrive in the shape with real and large. Such integrals rarely have closed forms, yet are almost always dominated by one point: as climbs, the weight towers wherever is largest and collapses to nothing everywhere else, so the whole integral is decided in a shrinking neighbourhood of the maximum. Laplace's method is the disciplined way to cash this in — locate the dominant maximum , expand the exponent to second order, recognise the resulting Gaussian bump, and integrate it exactly. The payoff is a formula of striking economy — area equals peak value times peak height times an effective width — plus a systematic ladder of corrections in powers of built from the higher derivatives of and . That ladder does not converge; it is asymptotic in Poincaré's sense, superb when truncated near its optimal order and divergent if pushed past it. The method is also the gateway to a whole family: rotate the exponent to imaginary values and it becomes the method of stationary phase; lift the contour into the complex plane and deform it across a saddle and it becomes the method of steepest descent, of which the real-axis Laplace case is the parent. Underneath statistical mechanics, the central limit theorem, semiclassical quantum mechanics, and the asymptotics of every special function, the same Gaussian-peak idea is quietly doing the work.
- Laplace's method gives the leading large- asymptotics of when the real exponent has a sharp interior maximum at .
- Near the maximum the exponent is quadratic, , so the integrand is a Gaussian of width .
- The leading result is — peak value, peak height, and effective width multiplied together.
- Endpoint maxima give scaling (Watson's lemma), a vanishing gives ; the correction series in is asymptotic and generally divergent.
- Worked out for the gamma function it delivers Stirling's formula, , accurate to 0.003% at .
- Key idea: for large the weight is a Gaussian peak of width at the maximum ; replace the integrand by that Gaussian and integrate exactly.
For large the weight is a Gaussian peak of width centred at the maximum ; replace the integrand by that Gaussian and integrate exactly.
Where this lives today
Laplace's method is not a museum piece; it is the everyday reflex for extracting numbers from stubborn integrals, and it sits at the base of several live research frontiers. In quantum field theory, path integrals with a large action are evaluated by saddle-point expansion about classical instanton solutions, and the Gaussian fluctuation determinant around the saddle — a descendant of the factor — sets tunnelling rates and vacuum decay probabilities. In statistics and machine learning the "Laplace approximation" is a workhorse for Bayesian inference: a posterior is approximated by a Gaussian at its mode, turning the intractable evidence integral into a Hessian determinant — the engine behind Gaussian-process and neural-network uncertainty estimates. Large-deviation theory, quantifying the exponentially small probabilities of rare events from finance to statistical physics, is at heart a saddle-point analysis of a generating function whose rate function is a Legendre transform. And the asymptotics of the special functions — Bessel, Airy, parabolic-cylinder — are still delivered to arbitrary order by equation (5) and its steepest-descent generalisation. An open direction is resurgence and Borel–Écalle summation, which reconnects the divergent tail of the series to the exponentially small non-perturbative contributions of subdominant saddles.
The physical picture
Watch grow with . The maximum rises exponentially faster than any neighbouring value, so a broad hump at becomes a needle at . Its height is , and how fast it falls away is set by the curvature : a sharply curved peak is narrow, a flat one wide. The area under a spike is height times width times a shape factor, and for a Gaussian that factor is — the entire leading formula in disguise. The first figure makes the collapse visible: three height-normalised weights whose half-widths shrink exactly as .
Why replace the true bump by a Gaussian at all? Because the region that matters is only wide, and over that shrinking window the higher Taylor terms of are self-defeatingly small: a cubic contribution scales as , a quartic as , and only the quadratic term stays . That is why the Gaussian is not an approximation of convenience but the honest leading behaviour, and why the corrections organise into powers of . The second figure shows the machine on the gamma-function integral, where the payoff is a real number: recovered to a fraction of a percent from a single Gaussian.
The core equations
Everything begins with a single archetype: a real exponent multiplied by a large parameter, weighted by a slowly varying amplitude. The behaviour as is decided by where is largest, not by the fine detail of .
where: — large positive parameter setting the sharpness of the peak; — real exponent, the "phase", whose maximum dominates; — slowly varying amplitude or prefactor; — location of the global maximum of on . For an interior maximum with and , the quadratic expansion turns the integrand into a Gaussian, and the answer is the product of three transparent factors: peak height, amplitude, and width.
where: — peak height; — amplitude at the peak; — effective width times ; since the curvature is negative. A sharper peak (larger ) is narrower and contributes less. The engine behind both the leading term and all corrections is the Taylor expansion of the exponent: the linear term is absent because is stationary, the quadratic term builds the Gaussian, and the cubic and quartic terms feed the series.
where: — curvature that fixes the width; — higher derivatives that generate the corrections, each weighted by an extra half-power of the small width . To turn those Taylor terms into numbers we need the moments of a Gaussian against . Only even powers survive — odd powers integrate to zero by symmetry, which is why the first correction is and not .
where: — the inverse variance; — the double factorial; odd moments vanish. The normalised averages are , , . Assembling those moments term by term promotes the leading formula to a full asymptotic expansion — a power series in multiplying the Gaussian.
where: — pure numbers built from the derivatives of and at . The series is asymptotic, not convergent: it is meant to be truncated, and its accuracy at fixed truncation improves as grows. The first coefficient is worth memorising, since it fixes the leading fractional error of the bare Laplace estimate. Working carefully with the signs — recall — the moments of equation (4) combine into a compact expression.
where: all quantities are evaluated at , with ; for constant amplitude only the first two terms survive. Because the middle term is positive, delivering the gamma integral's — a sign that is essential and easy to get backwards. The single most important instance is the gamma function, whose integral representation is tailor-made for the method and yields Stirling's formula in three lines.
where: equals at integer . The bracket is equation (5) for , and the is exactly with .
The goal is to derive the result rigorously for an interior nondegenerate maximum while tracking honestly what is thrown away, so that "replace the integrand by a Gaussian" becomes a controlled limit rather than a hopeful gesture. Assume has a unique global maximum at an interior point with , and is continuous with .
Step 1. Factor out the peak value, . Outside any fixed neighbourhood we have , so that region contributes at most . Why: this quarantines the answer into an arbitrarily small window around , and the discarded tails are exponentially smaller than any power of .
Step 2. Rescale to the natural width with , giving and . Why: this is the only scaling that keeps the quadratic term finite while sending every higher term to zero — what makes "the" width.
Step 3. Take the limit: the cubic remainder vanishes pointwise and , so dominated convergence gives . Why: with the tails already negligible, extending the limits to is free, and freezing at its peak value is legitimate because is slowly varying over the shrinking window.
Step 4. Evaluate the Gaussian, , and reassemble to reach . Why: the from the rescaling times the from the integral is the whole formula — three physical factors, one line. *For with , , , the formula reproduces — Stirling's formula.*
Go deeper · Derivation B · 1 minEndpoint maximum and the crossover to Watson's lemma
The goal is to show what changes when the maximum sits at a boundary with nonzero slope rather than at an interior stationary point: the Gaussian gives way to a one-sided exponential, and the scaling drops from to — precisely the regime Watson's lemma governs. Let the maximum lie at the left endpoint with so that decreases across , and .
Step 1. Because is not stationary, the linear term now leads: with . Why: at an ordinary endpoint the derivative does not vanish, so the exponent falls off linearly, and that slope — not a curvature — sets the decay.
Step 2. Substitute , so the natural width is rather than . Why: a linear exponent decays over a window times narrower than a quadratic one, which is the whole origin of the law.
Step 3. Integrate the one-sided exponential, . Why: only half a peak lies inside the domain, and , leaving the leading term Watson's lemma reproduces. *This result is identical to Watson's lemma applied to after the change of variable .*
Go deeper · Derivation C · 1 minFirst correction in 1/λ for a simple model
The goal is to compute the subleading term explicitly, exposing how the higher Taylor coefficients of feed the asymptotic series and pinning down the sign that is so easy to mishandle. Take and shift the interior maximum to with and ; write , , , so that .
Step 1. Scale so that . Why: the substitution sorts the Taylor terms by powers of — the cubic carries , the quartic — so every contribution's order is read off at a glance.
Step 2. Expand the non-Gaussian part of the exponential, . Why: the bare cubic is odd and integrates to zero, so the survivors are the quartic and the cubic-squared , both at — this is why enters only through .
Step 3. Take Gaussian averages with and , giving the bracket . Why: both surviving terms carry a plus sign — the exact point where careless algebra flips a sign.
Step 4. Assemble the boxed result, . Why: this is equation (5) with , the case of equation (6). *For about one has , , , so — exactly Stirling's .*
Limiting cases
The power of in the prefactor is dictated entirely by the local geometry of the maximum — whether it is interior or at an edge, whether the curvature is finite or vanishing, whether the amplitude survives at the peak.
| Case | Result | Meaning |
|---|---|---|
| Interior nondegenerate maximum | , , . The generic case; the prefactor scales as . | |
| Endpoint maximum (simple slope) | Maximum at with on . Half a peak and a linear exponent give scaling — the Watson's-lemma regime. | |
| Degenerate maximum, | Lowest nonvanishing derivative is order and negative. The peak is flatter, so it is wider: scaling becomes . | |
| Vanishing prefactor, | If the first surviving Gaussian moment is the second, giving an extra suppression. |
Worked examples
1 · Stirling's formula, with the factorial 10! recovered to numbers (fully worked)
Apply Laplace's method to , obtain Stirling's formula, and test it on against the exact .
Step 1. Put the integrand into Laplace form. Scale so that and , giving . The large parameter is and the exponent is .
Step 2. Locate and characterise the maximum. gives the interior maximum , with and , so and . The maximum is interior and nondegenerate — equation (2) applies.
Step 3. Assemble the leading term. With , , so . This is Stirling's formula.
Step 4. Add the first correction. From equation (6) with , , : , so .
Step 5. Put in numbers at . The leading term gives , which is below the exact ; multiplying by gives , now within of . One Gaussian plus one correction reproduces a seven-digit factorial to three decimal places.
2 · The modified Bessel function I₀(λ) at large argument (fully worked)
Use Laplace's method on the integral representation to find its large- asymptotics, and test at against the exact .
Step 1. Identify the exponent and its maximum. Here , maximal at the interior point with , , and , so . The prefactor is .
Step 2. Apply the leading formula. Equation (2) gives , so — the standard asymptotic of .
Step 3. Compute the correction. Expanding gives , , , so , and .
Step 4. Put in numbers at . The leading term is , below the exact ; times gives ( low), and the next term brings it to (). The successive partial sums close in on the true value — the signature of a good asymptotic series at moderate .
Physics of the portrait
Laplace's method is the mathematical distillate of a physical instinct: in a system with an overwhelmingly large parameter, the whole answer is carried by the most probable configuration plus Gaussian jitter around it — and it traces to a single figure who was as much a physicist of the heavens as a mathematician of chance.
Origins · 1 minPierre-Simon Laplace and how this was discovered
Pierre-Simon Laplace, the "Newton of France", spent his life showing that the visible order of the world was the overwhelmingly probable outcome of underlying law. In a 1774 memoir on the probability of causes he faced integrals with large, arising when many independent observations are combined, and introduced the device that now bears his name: expand the exponent about its maximum, keep the quadratic term, integrate the resulting Gaussian. In the monumental Théorie analytique des probabilités of 1812 it became a systematic tool for the asymptotics of the theory of errors — the same analysis that underlies the central limit theorem he did so much to establish. The method was not born in a vacuum: Stirling and de Moivre had already found, around 1730, that , the prototype result his technique reproduces in a few strokes. Its later life was richer still. Peter Debye lifted the idea into the complex plane as the method of steepest descent in 1909; G. N. Watson gave the rigorous endpoint lemma in 1918; and in the twentieth century the same Gaussian-peak philosophy became the saddle-point evaluation of partition functions and the stationary-phase backbone of semiclassical quantum mechanics. What Laplace built to tame the arithmetic of chance turned out to be the universal grammar of "large parameter, sharp peak".
Going further
Texts. Bender & Orszag, Advanced Mathematical Methods for Scientists and Engineers, §6.3–6.4 (the definitive treatment of Laplace's method and its corrections) · Arfken, Weber & Harris, Mathematical Methods for Physicists, 7th ed., Ch. 12 (asymptotic series) · Stone & Goldbart, Mathematics for Physics, ch. on asymptotic expansions · Hassani, Mathematical Physics, ch. on asymptotic methods · Byron & Fuller, Mathematics of Classical and Quantum Physics, on integral asymptotics · Olver, Asymptotics and Special Functions (rigorous error bounds). Key numerical checks: (1) the Gaussian moment identity ; (2) Stirling with — the sign is positive because the middle term of equation (6) has — reproducing to at ; (3) the endpoint scaling consistent with Watson's lemma; (4) the Bessel asymptotic , giving versus the exact at .
Builds on: Order Symbols and Gauge Functions · Asymptotic Series and Poincaré Expansions · Regular Perturbation Theory. Leads to: Watson's Lemma · Method of Steepest Descent and Saddle Points · Method of Stationary Phase · WKB Approximation.
Ask the tutor: Bring me any integral with a large parameter — a partition function, a Bessel or gamma asymptotic, a tunnelling amplitude — and we will find its dominant peak and read off the leading behaviour together.
When exactly is Laplace's method the right tool, as opposed to steepest descent or stationary phase?
Use Laplace's method when the exponent is real and has a genuine maximum on a real interval, with . If the exponent is purely imaginary, , the integrand oscillates rather than peaks and you need the method of stationary phase, whose dominant points are where and which carries a phase . If the exponent is complex, or the real maximum is inaccessible on the given contour, you deform the contour through a saddle point of — the method of steepest descent, of which Laplace's real-axis case is the special instance. In short: real peak is Laplace; oscillation is stationary phase; complex contour is steepest descent.
Why is the correction series divergent, and how can a divergent series be useful?
The coefficients are built from ever-higher Gaussian moments, which grow factorially, so eventually increases without bound no matter how large is. The series is asymptotic in Poincaré's sense: for a fixed truncation order , the error is of order the first omitted term and shrinks like as . In practice you truncate near the optimal order, roughly where consecutive terms stop shrinking (), and there the accuracy is exponentially good; summing past that point only makes things worse. To go further you need resummation — Borel summation reconstructs a function whose asymptotic expansion is the given series, with resurgence tying the ambiguities to exponentially small contributions from other saddles.
How do I know I have found the global maximum and not just a local one?
This is the assumption most often violated in practice, and getting it wrong produces answers that are not merely inaccurate but exponentially wrong. The safeguard is to evaluate at every candidate — all interior stationary points and both endpoints — and compare the values of itself, not of or , because the leading exponential swamps everything else. The largest value of wins outright; a competitor lower by a finite gap is suppressed by , and only exactly tied maxima are summed together. When depends on parameters, watch for a value where a subdominant maximum overtakes the leading one — a Stokes phenomenon, a discontinuous change in which saddle dominates.
Where does the √(2π) actually come from — is it fundamental or a coincidence?
It is the area under a unit Gaussian, , and it is as fundamental as the Gaussian's role as the universal shape of a smooth peak. Any function with a smooth interior maximum looks locally like an inverted parabola in its exponent, and exponentiating an inverted parabola gives a Gaussian; the constant is the once-and-for-all price of that shape. This is why the same turns up in Stirling's formula, in the normal distribution, and in the fluctuation determinant of a path integral — all the same integral in different clothes. Change the curvature and you rescale the width by , but the is invariant.
What happens if the second derivative vanishes at the maximum?
Then the peak is flatter than a parabola and the standard formula breaks down, because its width estimate diverges. You must keep the lowest nonvanishing derivative, say with , so that locally . The integral becomes a generalised Gaussian that evaluates to a gamma function, and the scaling softens from to — a flatter peak is wider and contributes more. In the complex-plane version this higher-order critical point is exactly what produces Airy-function (rather than Gaussian) behaviour near a coalescence of saddles.
Does the prefactor g(x) ever change the leading power of λ?
Only in the exceptional case that vanishes at the maximum. Generically , so freezing at its peak value is exact to leading order and the amplitude sets only the overall constant, not the power of . But if the leading Gaussian contribution disappears and the first surviving term comes from times the second moment , costing an extra factor of ; a nonzero contributes only an odd moment that vanishes, so you still land on the term. The rule of thumb: a nonzero amplitude shifts the constant, a vanishing one demotes the leading power.