The Arzela-Ascoli Theorem

The Arzelà–Ascoli theorem answers a deceptively simple question: when does a sequence of continuous functions possess a uniformly convergent subsequence? Pointwise boundedness alone is far too weak, and even uniform boundedness fails — the obstruction is equicontinuity, a uniform control on the moduli of continuity across the entire family. The theorem states that for functions on a compact metric (or more generally compact Hausdorff) space, uniform boundedness together with equicontinuity is exactly the condition for relative compactness in the supremum norm. The surprising fact is that compactness in an infinite-dimensional function space, which can never come for free from boundedness alone, is recovered precisely by adding a single uniform-regularity hypothesis — a phenomenon with no finite-dimensional analogue. This makes Arzelà–Ascoli the workhorse behind countless existence proofs, from Peano's theorem to the calculus of variations.

The Core Insight

Boundedness gives you control at each point; equicontinuity transfers that control uniformly across points. The marriage of the two lets a diagonal argument pick out a subsequence that converges first on a countable dense set, and then equicontinuity spreads that pointwise convergence into uniform convergence on the whole compact domain. Compactness = (pointwise pre-compactness on a dense set) + (uniform regularity that interpolates the rest).

Formal Statement

Equicontinuity

Let $(X,d)$ and $(Y,\rho )$ be metric spaces and $\mathcal{F}\subseteq C(X,Y)$ a family of continuous functions.

• $\mathcal{F}$ is equicontinuous at a point $x_0\in X$ if

• $\mathcal{F}$ is (pointwise) equicontinuous if it is equicontinuous at every $x_0\in X$.

• $\mathcal{F}$ is uniformly equicontinuous if $\delta$ may be chosen independent of $x_0$:

Uniform Boundedness and Pointwise Boundedness

• pointwise bounded if for each $x$, ${\sup }_{f\in \mathcal{F}}\Vert f(x)\Vert <\infty$;
• uniformly bounded if ${\sup }_{f\in \mathcal{F}}{\sup }_{x\in X}\Vert f(x)\Vert ={\sup }_{f\in \mathcal{F}}\Vert f{\Vert }_{\infty }<\infty$.

On a compact $X$, pointwise boundedness + equicontinuity automatically upgrades to uniform boundedness.

Arzelà–Ascoli, Classical Form

Let $K$ be a compact metric space and let $\{f_n{\}}_{n\ge 1}\subseteq C(K,{\mathbb{R}}^m)$. If

1. $\{f_n\}$ is uniformly bounded: ${\sup }_n\Vert f_n{\Vert }_{\infty }<\infty$, and
2. $\{f_n\}$ is equicontinuous,

then $\{f_n\}$ has a subsequence converging uniformly on $K$ (i.e. in the norm $\Vert \cdot {\Vert }_{\infty }$).

Arzelà–Ascoli, Compactness Form

Let $K$ be a compact Hausdorff space. A subset $\mathcal{F}\subseteq C(K,{\mathbb{R}}^m)$ is relatively compact (its closure is compact) in $(C(K),\Vert \cdot {\Vert }_{\infty })$ if and only if $\mathcal{F}$ is pointwise bounded and equicontinuous.

Equivalently: $\mathcal{F}$ is relatively compact $⟺$ it is uniformly bounded and equicontinuous. Since $C(K)$ is a complete metric space, relative compactness $⟺$ total boundedness of $\mathcal{F}$.

Equicontinuity on Compact Domains

If $K$ is compact and $\mathcal{F}\subseteq C(K,Y)$ is pointwise equicontinuous, then $\mathcal{F}$ is uniformly equicontinuous.

Why It Holds — Derivation

Proof of the Classical Form: Diagonal + Spreading

Thus $g_n(x)$ converges for every $x\in D$.

By compactness, $K$ is covered by finitely many balls $B(y_j,\delta )$, $j=1,\dots ,N$, with $y_j\in D$ (density lets us put centers in $D$).

Therefore $\{g_n\}$ is uniformly Cauchy. Since $(C(K),\Vert \cdot {\Vert }_{\infty })$ is complete, $g_n\to g$ uniformly, and $g\in C(K)$ (uniform limit of continuous functions is continuous). $■$

Proof that Compactness $\Rightarrow$ the Two Conditions (Necessity)

Suppose $\overline{\mathcal{F}}$ is compact in $C(K)$.

Proof of Equicontinuity on Compact Domains

Assume $\mathcal{F}$ pointwise equicontinuous on compact $K$; fix $\epsilon >0$. For each $x\in K$ pick ${\delta }_x>0$ so that $d(z,x)<{\delta }_x\Rightarrow \Vert f(z)-f(x)\Vert <\epsilon /2$ for all $f$. The balls $\{B(x,{\delta }_x/2)\}$ cover $K$; extract a finite subcover with centers $x_1,\dots ,x_N$ and set $\delta =\frac{1}{2}{\min }_i{\delta }_{x_i}$. If $d(x,x^{\prime })<\delta$, then $x\in B(x_i,{\delta }_{x_i}/2)$ for some $i$, and $d(x^{\prime },x_i)\le d(x^{\prime },x)+d(x,x_i)<\delta +{\delta }_{x_i}/2\le {\delta }_{x_i}$, so both lie within ${\delta }_{x_i}$ of $x_i$; hence

Cesare Arzelà & Giulio Ascoli | 1847–1912, 1843–1896

Giulio Ascoli (Trieste, Milan) introduced the notion of equicontinuity in 1883–84 while studying the question of when a set of curves admits a "limit curve," giving the sufficiency of equicontinuity for extracting convergent sequences. Cesare Arzelà (Bologna) sharpened and completed the theory in the 1880s–1895, establishing the necessary and sufficient characterization and applying it to the existence of solutions of differential equations and to the calculus of variations. Arzelà's work on the term-by-term integration of series and on functions of lines (functionals) places him among the founders of functional analysis, alongside Vito Volterra. The theorem fuses their contributions: Ascoli's concept, Arzelà's completeness.

Building Intuition

Picture each $f_n$ as a wiggly graph over $K$. Uniform boundedness keeps all the graphs trapped in a horizontal band — they can't run off to infinity. Equicontinuity caps how fast any of them can wiggle: no matter which function you pick, moving a little in $x$ changes the height by only a little, with the same "little" working for the whole family. A bounded but wildly oscillating family (frequencies $\to \infty$) escapes compactness because no subsequence settles down. Equicontinuity forbids the runaway oscillation, so the graphs are "tame" enough that a diagonal-selected subsequence — which already agrees at a dense scaffold of points — has nowhere to misbehave in the gaps. In finite dimensions, bounded $\Rightarrow$ relatively compact (Heine–Borel). In $C(K)$ that fails; equicontinuity is exactly the extra ingredient that restores it.

Equicontinuity tames oscillation: bounded-but-wild $\sin(nx)$ escapes compactness, while an equicontinuous family is trapped in a controllable tube.

Worked Examples

Extracting a Convergent Subsequence from an Integral Family

Peano Existence Theorem via Arzelà–Ascoli

Common Misconceptions

1. Dropping compactness of the domain. On a non-compact domain (e.g. $\mathbb{R}$) uniform boundedness + equicontinuity does not imply a uniformly convergent subsequence — mass can escape to infinity. One needs a locally uniform / $\sigma$-compact version with a diagonal argument over an exhaustion.
2. Equicontinuity is a property of the family, not of single functions. Every $f_n$ can be uniformly continuous while $\{f_n\}$ fails to be equicontinuous.

Bounded + Each Continuous, but NOT Equicontinuous

Let $f_n(x)=\sin (nx)$ on $[0,\pi ]$. Each is smooth, $\Vert f_n{\Vert }_{\infty }=1$ (uniformly bounded). But $\{f_n\}$ is not equicontinuous: near any point the slope $n\cos (nx)$ blows up, so no single $\delta$ works for all $n$. Indeed $\{f_n\}$ has no uniformly (nor even pointwise) convergent subsequence — by ${\int }_0^{\pi }(\sin nx-\sin mx{)}^2=\pi$ for $n\ne m$, no subsequence is Cauchy in $L^2$, hence none in sup norm. Compactness fails precisely because equicontinuity fails.

Connections

Arzelà–Ascoli is the prototype of all compactness-by-extraction theorems and sits in a web of related results:

• Heine–Borel Theorem — finite-dimensional ancestor; A–A is its replacement in $C(K)$, with equicontinuity standing in for the boundedness that no longer suffices.
• Stone–Weierstrass Theorem — companion structural theorem on $C(K)$: density (approximation) versus A–A's compactness (selection).
• Banach–Alaoglu Theorem — the dual phenomenon: weak-* compactness of bounded sets; A–A can be derived as a special case in suitable settings.
• Rellich–Kondrachov Theorem — Sobolev-space analogue: compact embedding $W^{1,p}\hookrightarrow L^p$ on bounded domains, proved using A–A-type equicontinuity estimates via Sobolev bounds.
• Montel's Theorem — complex-analytic refinement: a locally bounded family of holomorphic functions is normal, because Cauchy estimates supply equicontinuity automatically.
• Modulus of Continuity — equicontinuity = a common modulus of continuity for the whole family.

Real-World Applications

1. Existence theory for ODEs (Peano's theorem). Compactness of approximate-solution families yields existence without uniqueness — the backbone of qualitative ODE theory.
2. Calculus of variations / direct method. Minimizing sequences with bounded derivatives are equicontinuous; A–A extracts a convergent subsequence whose limit is the minimizer — used in geodesic existence, minimal surfaces, elasticity.
3. PDE compactness arguments. Galerkin and viscosity-solution methods, the Navier–Stokes existence theory (Leray), and homogenization rely on extracting limits via Arzelà–Ascoli or its Sobolev cousins.
4. Dynamical systems & normal families. Equicontinuous families of iterates underlie the Fatou/Julia dichotomy in complex dynamics (via Montel) and equicontinuity criteria for stability.
5. Control theory & optimal control. Filippov's lemma and existence of optimal trajectories use compactness of admissible-trajectory families in $C([0,T])$.
6. Numerical analysis. Convergence proofs for finite-element and finite-difference schemes use uniform bounds + equicontinuity (or discrete analogues) to guarantee a convergent subsequence approaching the true solution.
7. Riemannian geometry / Gromov compactness. Cheeger–Gromov convergence of manifolds with bounded geometry packages an A–A-type harvest of limit metrics from equicontinuous chart maps.

Historical Development

• 1883–1884 — Giulio Ascoli introduces equicontinuity ("egual continuità") and proves that an equicontinuous, bounded family of curves admits a uniformly convergent subsequence (Le curve limiti di una varietà data di curve).
• 1889 — Cesare Arzelà extends and clarifies the convergence theory of sequences of functions; develops the notion of "convergenza in egual grado" (uniform convergence) systematically.
• 1895 — Arzelà states the full necessary-and-sufficient characterization and applies it; the combined result becomes known as the Arzelà–Ascoli theorem.
• 1890s–1900s — Vito Volterra and the Italian school use the theorem in the nascent theory of functionals ("functions of lines"), an embryo of functional analysis.
• 1906 — Maurice Fréchet casts the theorem in abstract metric-space language in his thesis, founding general topology and giving compactness its modern setting.
• 1932 — Stefan Banach's Théorie des opérations linéaires situates A–A within the structural theory of function spaces.
• 1937 — M. H. Stone and the Bourbaki program generalize $C(K)$ theory; the compactness form for compact Hausdorff $K$ is standardized.
• 1940s–50s — Generalizations to uniform spaces and to families valued in compact metric spaces (Bourbaki, Kelley) reach full modern abstraction.
• 1960s– — Sobolev-space analogues (Rellich–Kondrachov) and geometric versions (Gromov compactness, 1981) extend the equicontinuity philosophy across analysis and geometry.

Subtleties & Limits

• Infinite-dimensional or non-locally-compact targets. For maps into a general metric space $Y$, one must add that for each $x$ the set $\{f(x):f\in \mathcal{F}\}$ is relatively compact in $Y$ — "uniform boundedness" alone is insufficient when $Y$ is infinite-dimensional. Finding sharp, easily-checkable target conditions in Banach-valued settings remains delicate.
• Vector-valued and operator-valued analogues. Characterizing compactness of families of operators or of $C(K,X)$-valued maps in the strong/weak topologies blends A–A with weak-compactness theory (Dunford–Pettis, Eberlein–Šmulian); clean criteria are case-specific.
• Quantitative / effective versions. Translating "a subsequence converges" into explicit rates (effective Arzelà–Ascoli) requires modulus-of-continuity bookkeeping and is an active topic in computable analysis and reverse mathematics, where the theorem is known to be non-constructive (it implies weak König's lemma).
• Optimal regularity substitutes. In PDE, replacing equicontinuity by fractional Sobolev or Besov compactness (Aubin–Lions–Simon lemmas for time-dependent problems) continues to be refined for nonlinear evolution equations.

See Also