Calculus of Variations

Calculus of Variations is the branch of mathematics that finds functions which minimize or maximize integral quantities (functionals). Key result: a function extremizing

\int_{a}^{b} L (x, y, y^{'}) d x

must satisfy the Euler–Lagrange equation

\frac{\partial L}{\partial y} - \frac{d}{d x} \frac{\partial L}{\partial y ^{'}} = 0

. Applies to: mechanics, optics, geometry (geodesics), economics, control theory. Origins: Bernoulli's brachistochrone (1696), formalized by Euler (1744) and Lagrange (1755).

The calculus of variations seeks to optimize functionals — rules that assign a real number to an entire function, typically through an integral. Where ordinary calculus minimizes $f (x)$ over points $x$ , here we minimize $J [y]$ over whole curves $y (x)$ . It matters because an astonishing range of physical laws can be stated as principles of least (or stationary) action: light bends to minimize travel time, soap films minimize area, and particles trace paths that extremize action. The surprising fact is that requiring stationarity of a single integral collapses into a differential equation — the Euler–Lagrange equation — so an infinite-dimensional optimization becomes an ODE or PDE problem solvable by familiar techniques.

The Core Insight

To find the function that extremizes a functional, perturb it slightly and demand that the first-order change vanishes — exactly as $f^{'} (x) = 0$ at an ordinary extremum. The perturbation is an arbitrary function $η (x)$ , and demanding zero first variation for all $η$ forces a local condition at every point: the Euler–Lagrange equation. The whole subject is the differential calculus of $f^{'} (x) = 0$ lifted to infinite dimensions.

Formal Statement

Functional and the Basic Problem

A functional $J$ maps functions to real numbers. The classical (fixed-endpoint) problem is to extremize

J [y] = \int_{a}^{b} L (x, y (x), y^{'} (x)) d x

⟳

L

is the

Lagrangian (integrand); $y (x)$ is the unknown curve with prescribed endpoints $y (a) = y_{a}$ , $y (b) = y_{b}$ ; $y^{'} = d y / d x$ .

The admissible class is $y \in C^{2} [a, b]$ satisfying the boundary conditions. The symbols are:

$x$ — independent variable;
$y$ — the function to be determined;
$y^{'}$ — its derivative;
$L (x, y, y^{'})$ — a given smooth function of three arguments.

First Variation

Replace $y$ by $y + ε η$ where $η (a) = η (b) = 0$ and $ε \in R$ . The first variation is

δ J = \frac{d}{d ε} J [y + ε η]_{ε = 0}

⟳differentiate

J [y + ε η]

under the integral sign and set

ε = 0

; this is the directional derivative of

J

in the "direction"

η

A function $y$ is a stationary point (extremal) of $J$ if $δ J = 0$ for every admissible $η$ .

Euler–Lagrange Equation

If $y \in C^{2} [a, b]$ extremizes $J [y] = \int_{a}^{b} L (x, y, y^{'}) d x$ among functions with fixed endpoints, then $y$ satisfies

\frac{\partial L}{\partial y} - \frac{d}{d x} (\frac{\partial L}{\partial y ^{'}}) = 0

⟳set the first variation to zero, integrate the

η^{'}

term by parts, then invoke the fundamental lemma since

η

is arbitrary.

Beltrami Identity — Autonomous Case

If $L$ does not depend explicitly on $x$ (i.e. $\partial L / \partial x = 0$ ), then any extremal satisfies the first integral

L - y^{'} \frac{\partial L}{\partial y ^{'}} = C

⟳compute

\frac{d}{d x} (L - y^{'} L_{y^{'}})

, substitute the Euler–Lagrange equation, and observe the result is

\partial L / \partial x = 0

, so the bracket is constant

C

Why It Holds / Derivation

Deriving the Euler–Lagrange Equation

Step 1 — Embed in a family. Suppose

y

is an extremal. Form

Y (x, ε) = y (x) + ε η (x)

with

η \in C^{2}

η (a) = η (b) = 0

. Define

Φ (ε) = J [Y] = \int_{a}^{b} L (x, Y, Y^{'}) d x

. Since

y

is stationary,

Φ

has an extremum at

ε = 0

, so

Φ^{'} (0) = 0

. Step 2 — Differentiate under the integral. By the chain rule,

Φ^{'} (0) = \int_{a}^{b} (\frac{\partial L}{\partial y} η + \frac{\partial L}{\partial y ^{'}} η^{'}) d x = 0

⟳

\partial Y / \partial ε = η

and

\partial Y^{'} / \partial ε = η^{'}

; evaluate partials of

L

ε = 0

Step 3 — Integrate by parts. For the second term,

\int_{a}^{b} \frac{\partial L}{\partial y ^{'}} η^{'} d x = [\frac{\partial L}{\partial y ^{'}} η]_{a}^{b} - \int_{a}^{b} η \frac{d}{d x} (\frac{\partial L}{\partial y ^{'}}) d x

⟳standard integration by parts with

u = \partial L / \partial y^{'}

d v = η^{'} d x

Step 4 — Kill the boundary term. Because

η (a) = η (b) = 0

, the bracket vanishes. Combining,

\int_{a}^{b} η (x) [\frac{\partial L}{\partial y} - \frac{d}{d x} \frac{\partial L}{\partial y ^{'}}] d x = 0

⟳substitute [6] into [5] and factor out

η

Step 5 — Apply the fundamental lemma. Since

η

is arbitrary (subject only to vanishing endpoints), the bracketed quantity must vanish identically; otherwise choose

η

matching its sign to make the integral positive. Hence

\frac{\partial L}{\partial y} - \frac{d}{d x} \frac{\partial L}{\partial y ^{'}} = 0. ■

⟳this is the

fundamental lemma of the calculus of variations — a continuous function whose weighted integral against all such $η$ is zero must be identically zero.

Leonhard Euler | 1707–1783

Euler systematized the subject in his 1744 treatise Methodus inveniendi lineas curvas maximi minimive proprietate gaudentes, deriving the central equation by a discretization argument (replacing the curve with a polygon and taking a limit). The elegant variational derivation came from the young Joseph-Louis Lagrange, whose 1755 letter to Euler introduced the $δ$ -operator and the perturbation method used today. Euler graciously named the field after Lagrange's method, and the resulting equation bears both names.

Building Intuition

Think of the functional $J [y]$ as a landscape sitting over an infinite-dimensional space whose "points" are entire curves. At a minimizing curve the landscape is flat in every direction — and the directions are precisely the perturbations $η (x)$ . Demanding flatness in all directions at once is far stronger than in finite dimensions, and that overdetermination is what crushes the problem down to a pointwise differential equation. The boundary term in the integration by parts is "the gradient leaking out the ends"; fixing the endpoints with $η (a) = η (b) = 0$ plugs the leak. When the endpoints are free, that leaked term cannot be dropped and instead yields natural boundary conditions $L_{y^{'}} = 0$ at the ends.

A curve y(x) and a perturbed competitor y+εη, both pinned at the endpoints

Worked Examples

Shortest Path Between Two Points

Given: Minimize arc length

J [y] = \int_{x_{1}}^{x_{2}} 1 + y^{'2} d x

between

(0, 0)

and

(4, 3)

. Step 1 — Identify the Lagrangian.

L = 1 + y^{'2}

. Note

\partial L / \partial y = 0

and

L

has no explicit

x

. Step 2 — Euler–Lagrange. Since

\partial L / \partial y = 0

, equation [3] gives

\frac{d}{d x} \frac{\partial L}{\partial y ^{'}} = 0

, so

\frac{\partial L}{\partial y ^{'}} =

const:

\frac{y ^{'}}{1 + y ^{'2}} = C

⟳differentiate

L

with respect to

y^{'}

and set it equal to a constant from the conserved-momentum form of E–L.

Step 3 — Solve. This forces

y^{'} =

const

= m

, hence

y = m x + b

(a straight line). Apply endpoints:

b = 0

m = 3/4

. Step 4 — Compute length.

J = 1 + (3/4)^{2} \cdot 4 = 25/16 \cdot 4 = \frac{5}{4} \cdot 4

y = \frac{3}{4} x, J = 5 units

The Brachistochrone

Given: A bead slides without friction from

(0, 0)

(x_{1}, y_{1})

under gravity

g

. Find the curve minimizing descent time. Measuring

y

downward, speed

v = 2 g y

, so

T [y] = \int_{0}^{x_{1}} \frac{1 + y ^{'2}}{2 g y} d x

⟳time

= \int d s / v

with

d s = 1 + y^{'2} d x

and energy conservation

\frac{1}{2} v^{2} = g y

Step 1 — Autonomous in $x$ .

L = (1 + y^{'2}) / (2 g y)

has no explicit

x

, so use the Beltrami identity [4]:

L - y^{'} \frac{\partial L}{\partial y ^{'}} = \frac{1}{2 g y 1 + y ^{'2}} = C

⟳substitute

L

into [4]; the

y^{'}

terms combine over a common denominator

1 + y^{'2}

Step 2 — Rearrange. This gives

y (1 + y^{'2}) = k

where

k = 1/ (2 g C^{2})

is constant. Step 3 — Parametrize. Substituting

y^{'} = cot (θ /2)

yields the cycloid

x = \frac{k}{2} (θ - sin θ), y = \frac{k}{2} (1 - cos θ)

For a drop to

(x_{1}, y_{1}) = (π, 2)

m, one finds

k = 2

θ \in [0, π]

, giving descent time

T = π / g \approx 1.00

s (with

g = 9.81

m/s²,

T \approx 1.00

s).

Common Misconceptions

Stationary ≠ minimum. The Euler–Lagrange equation is a necessary condition for an extremum, not sufficient. Its solutions are stationary points; they may be minima, maxima, or saddle points (or none of these). To confirm a minimum you need second-order tests — the second variation

δ^{2} J \geq 0

, the Legendre condition

\partial^{2} L / \partial y^{'2} \geq 0

, and the Jacobi condition (no conjugate points in

(a, b)

). A solution of E–L can fail to be a minimizer if a conjugate point appears. Existence is not guaranteed. Writing down the Euler–Lagrange equation presumes a smooth minimizer exists. Many functionals have no minimizer in the smooth class, or the infimum is not attained. The modern direct method addresses existence separately, requiring coercivity and (sequential weak lower) semicontinuity — properties tied to convexity of $L$ in $y^{'}$ .

Weierstrass's Non-Existence Example

Consider $J [y] = \int_{- 1}^{1} x^{2} y^{'2} d x$ with $y (- 1) = - 1$ , $y (1) = 1$ . The infimum is $0$ (approached by curves that rise steeply near $x = 0$ where the weight $x^{2}$ vanishes), but no admissible $C^{1}$ function attains $J = 0$ , since that would require $y^{'} = 0$ wherever $x \neq = 0$ , contradicting the boundary conditions. The Euler–Lagrange equation has solutions, yet the minimization problem has no smooth solution — a famous demonstration that E–L alone settles nothing about existence.

Connections

The calculus of variations is the mathematical engine of Lagrangian mechanics: with $L = T - V$ (kinetic minus potential energy), Hamilton's Principle states that physical trajectories extremize the action $\int L d t$ , and [3] becomes Newton's laws in disguise. A Legendre transform of $L$ produces the Hamiltonian and connects to Hamiltonian Mechanics and symplectic geometry. The role of symmetries is captured by Noether's Theorem, which links continuous symmetries of $L$ to conserved quantities (the Beltrami identity [4] is the special case of time-translation symmetry). When constraints are present, Lagrange Multipliers generalize to isoperimetric and holonomic constraint problems. Replacing one independent variable by several upgrades [3] to a partial differential equation, linking to Partial Differential Equations and the Dirichlet Principle for harmonic functions.

Real-World Applications

Optics (Fermat's Principle): Light follows the path of stationary optical length $\int n d s$ ; refraction (Snell's law) and lens design follow directly.
Classical mechanics: Every equation of motion in robotics, orbital dynamics, and molecular simulation can be generated from a Lagrangian via [3].
Minimal surfaces & soap films: Architecture (tensile roofs, the Munich Olympic Stadium) and the physics of bubbles are governed by area-minimizing functionals.
Optimal control & aerospace: Pontryagin's Maximum Principle, the control-theoretic descendant of variational methods, computes fuel-minimal rocket trajectories and spacecraft transfers.
General relativity: Geodesics — the paths of free-falling bodies and light — extremize the spacetime interval $\int d s$ ; the Einstein equations themselves derive from the Einstein–Hilbert action.
Economics & finance: Ramsey's optimal-growth model and continuous-time consumption problems maximize discounted utility functionals over time.
Image processing: Total-variation denoising and the Mumford–Shah model restore images by minimizing energy functionals balancing fidelity and smoothness.

Historical Development

1696 — Johann Bernoulli poses the brachistochrone problem as a public challenge; solutions arrive from Newton, Leibniz, l'Hôpital, and both Bernoullis.
1697 — Newton solves it overnight (anonymously), prompting Bernoulli's remark, "I recognize the lion by his claw."
1744 — Euler publishes Methodus inveniendi…, the first systematic treatment, deriving the central equation via polygonal approximation.
1755 — Lagrange (age 19) writes to Euler introducing the $δ$ -calculus and the perturbation method; the field is named calculus of variations.
1786 — Legendre proposes the second-variation sign condition ( $L_{y^{'} y^{'}} \geq 0$ ) for distinguishing minima.
1837 — Jacobi develops the theory of conjugate points, completing the second-order sufficiency analysis.
1879 — Weierstrass introduces strong variations, the excess function, and rigorous sufficiency conditions; exposes flaws in the naive Dirichlet Principle.
1900 — Hilbert's 19th, 20th, and 23rd problems revitalize the field; Hilbert rehabilitates the direct method and the Dirichlet Principle.
1915 — Emmy Noether proves her theorem linking variational symmetries to conservation laws.

Subtleties & Limits

The leap from finite to infinite dimensions introduces genuine hazards. Regularity: does a minimizer obtained by the direct method possess enough derivatives to satisfy the Euler–Lagrange equation classically? Hilbert's 19th problem (analyticity of minimizers for analytic, convex $L$ ) was settled for scalar problems by De Giorgi and Nash (1957), but partial regularity is the best possible for vector-valued problems — singular sets genuinely occur, and their structure remains an active research frontier. Lavrentiev's phenomenon: the infimum over Lipschitz functions can strictly exceed the infimum over smooth ones, so the choice of admissible class is not innocent. Non-convex functionals may fail to attain their infimum, forcing the machinery of relaxation, Young measures, and quasiconvexity (Morrey) — and deciding whether a given function is quasiconvex is, in general, undecidable in known terms. These issues mean the clean undergraduate story (write E–L, solve) is the surface of a deep and still-developing theory.

Calculus of Variations

The Core Insight

Formal Statement

Functional and the Basic Problem

First Variation

Euler–Lagrange Equation

Beltrami Identity — Autonomous Case

Why It Holds / Derivation

Deriving the Euler–Lagrange Equation

Leonhard Euler | 1707–1783

Building Intuition

A curve y(x) and a perturbed competitor y+εη, both pinned at the endpoints

Worked Examples

Shortest Path Between Two Points

The Brachistochrone

Common Misconceptions

Weierstrass's Non-Existence Example

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also

Before this

Where this leads