Compactness — Heine-Borel and Bolzano-Weierstrass

Compactness is a topological property generalizing "closed and bounded." For subsets of

R^{n}

, the Heine–Borel theorem says compact = closed and bounded, while the Bolzano–Weierstrass theorem says every bounded sequence has a convergent subsequence. These results are the cornerstone of real analysis, guaranteeing maxima, uniform continuity, and the convergence machinery used throughout calculus, optimization, and differential equations. Named for Eduard Heine, Émile Borel, Bernard Bolzano, and Karl Weierstrass (1817–1895).

A subset $K$ of a metric space is compact if every open cover of $K$ admits a finite subcover. This abstract definition is equivalent, in $R^{n}$ , to the concrete condition that $K$ is closed and bounded (Heine–Borel), and to sequential compactness — every sequence in $K$ has a subsequence converging to a point of $K$ (Bolzano–Weierstrass). Compactness matters because it turns "infinite" problems into "finite" ones: it forces continuous functions to attain extrema, makes them uniformly continuous, and ensures that local information glued together stays controllable. The surprising fact is that the seemingly modest open-cover definition is exactly the right abstraction — in general topological spaces it diverges from "closed and bounded," and the Heine–Borel equivalence is a special privilege of finite-dimensional normed spaces.

The Core Insight

Compactness is finiteness in disguise. A compact set is one where any attempt to cover it with infinitely many open pieces always over-covers — finitely many already suffice. Equivalently, no sequence can "escape" — there is always a cluster point inside. This bridges the local (open sets, neighborhoods) and the global (the whole set), letting analysis trade unbounded processes for finite, manageable ones.

Formal Statement

Open Cover and Compactness

Let $(X, d)$ be a metric space (or any topological space) and $K \subseteq X$ . A collection $U = {U_{α}}_{α \in A}$ of open sets is an open cover of $K$ if

K \subseteq α \in A ⋃ U_{α} .

⟳this is the defining inclusion — every point of

K

lies in at least one cover element.

A finite subcover is a finite subcollection $U_{α_{1}}, \dots, U_{α_{n}}$ with

K \subseteq i = 1 ⋃ n U_{α_{i}} .

⟳choose finitely many indices

α_{1}, \dots, α_{n} \in A

that still cover

K

K

is compact if every open cover of

K

has a finite subcover. Here

A

is an arbitrary (possibly uncountable) index set.

Boundedness, Closedness, Sequential Compactness

K \subseteq R^{n}

is bounded if it fits inside some ball:

\exists M > 0 : ∥ x ∥ \leq M for all x \in K .

⟳

M

is any radius enclosing

K

; equivalently

diam (K) < \infty

K

is closed if it contains all its limit points: whenever

x_{k} \in K

and

x_{k} \to x

, then

x \in K

K

is sequentially compact if every sequence

(x_{k})_{k \geq 1}

K

has a subsequence

(x_{k_{j}})

converging to some limit

L \in K

\forall (x_{k}) \subseteq K \exists (x_{k_{j}}), L \in K : j \to \infty lim x_{k_{j}} = L .

⟳extract indices

k_{1} < k_{2} < \dots

so the resulting subsequence has a limit inside

K

Heine–Borel

A subset $K \subseteq R^{n}$ is compact if and only if it is closed and bounded.

K compact ⟺ K closed \land K bounded .

⟳the forward direction holds in any metric space; the converse uses the completeness and finite-dimensionality of

R^{n}

Bolzano–Weierstrass

Every bounded sequence in $R^{n}$ has a convergent subsequence. Consequently, a subset $K \subseteq R^{n}$ is compact iff it is sequentially compact. In a general metric space:

K compact ⟺ K sequentially compact ⟺ K complete and totally bounded .

⟳in metric spaces the three notions coincide; "totally bounded" replaces "bounded" once you leave

R^{n}

Why It Holds / Derivation

Bolzano–Weierstrass in $\mathbb{R}$ via bisection

We show every bounded real sequence $(x_{k})$ has a convergent subsequence.

Step 1. Since

(x_{k})

is bounded, all terms lie in an interval

I_{0} = [a_{0}, b_{0}]

of length

L = b_{0} - a_{0}

. Step 2. Bisect

I_{0}

into two halves. At least one half contains

x_{k}

for infinitely many indices

k

; call it

I_{1} = [a_{1}, b_{1}]

, of length

L /2

. Step 3. Repeat. Inductively obtain nested intervals

I_{0} \supseteq I_{1} \supseteq I_{2} \supseteq \dots, ∣ I_{n} ∣ = \frac{L}{2 ^{n}},

⟳each bisection halves the length and keeps the half containing infinitely many terms.

each containing infinitely many terms of the sequence. Step 4. By the Nested Interval Property (a form of completeness of

R

n = 0 ⋂ \infty I_{n} = {L^{*}}

⟳lengths

\to 0

and the intervals are nested, so the intersection is a single point

L^{*}

is a single point. Step 5. Build the subsequence greedily: choose

k_{1}

with

x_{k_{1}} \in I_{1}

; having chosen

k_{j}

, pick

k_{j + 1} > k_{j}

with

x_{k_{j + 1}} \in I_{j + 1}

(possible because

I_{j + 1}

holds infinitely many terms). Then

∣ x_{k_{j}} - L^{*} ∣ \leq ∣ I_{j} ∣ = L / 2^{j} \to 0

, so

x_{k_{j}} \to L^{*}

■

For $R^{n}$ , apply the result coordinate-by-coordinate: extract a subsequence convergent in coordinate 1, then a further subsequence convergent in coordinate 2, and so on through coordinate $n$ .

Heine–Borel, both directions

(⇒) Compact ⟹ closed and bounded. Bounded: The balls

{B (0, m)}_{m \in N}

form an open cover of

K

. A finite subcover is contained in the largest ball

B (0, M)

, so

K \subseteq B (0, M)

is bounded. Closed: Suppose

x \in / K

. For each

y \in K

let

r_{y} = \frac{1}{2} d (x, y) > 0

. The balls

{B (y, r_{y})}_{y \in K}

cover

K

; take a finite subcover

B (y_{1}, r_{y_{1}}), \dots, B (y_{m}, r_{y_{m}})

. Set

δ = min_{i} r_{y_{i}} > 0

. Then

B (x, δ)

misses all those balls, hence misses

K

, so

x

is not a limit point. Thus the complement of

K

is open and

K

is closed. (⇐) Closed and bounded ⟹ compact (for

R^{n}

). Step 1 — the box is compact. First show a closed box

Q_{0} = [a, b]^{n}

is compact, by contradiction. Suppose

U

is an open cover of

Q_{0}

with no finite subcover. Bisect each edge to split

Q_{0}

into

2^{n}

sub-boxes. At least one sub-box

Q_{1}

has no finite subcover. Iterate to get nested boxes

Q_{0} \supseteq Q_{1} \supseteq \dots, diam (Q_{k}) = \frac{diam ( Q _{0} )}{2 ^{k}} \to 0,

⟳each step halves the diameter; "no finite subcover" passes to at least one child by pigeonhole.

none admitting a finite subcover. Step 2. By completeness,

⋂_{k} Q_{k} = {p}

for a single point

p

. Since

U

covers

Q_{0}

, some

U \in U

contains

p

, and being open,

U \supseteq B (p, ε)

for some

ε > 0

. Step 3. For

k

large,

diam (Q_{k}) < ε

and

p \in Q_{k}

, so

Q_{k} \subseteq B (p, ε) \subseteq U

. Then

{U}

alone is a finite subcover of

Q_{k}

— contradicting its choice. Hence

Q_{0}

is compact. Step 4 — closed subset of compact is compact. Let

K

be closed and bounded; then

K \subseteq Q_{0}

for some box. Given an open cover

U

K

, add the open set

X ∖ K

to get an open cover of

Q_{0}

. Extract a finite subcover; discarding

X ∖ K

leaves finitely many elements of

U

covering

K

■

Bisection argument: nested boxes shrink onto a single point, trapped inside one cover element $U$

Karl Weierstrass | 1815–1897

Weierstrass, the "father of modern analysis," made rigor the law of calculus. Working largely from lecture notes (he published little), he supplied the $ε$ – $δ$ definitions that tamed limits, constructed the famous everywhere-continuous nowhere-differentiable function, and proved that a continuous function on a closed bounded interval attains its maximum and minimum — the Extreme Value Theorem, a direct child of compactness. The Bolzano–Weierstrass theorem bears his name because he rediscovered and disseminated, with full rigor, the cluster-point principle that Bolzano had stated decades earlier in relative obscurity.

Building Intuition

Think of compactness as "no room to run and no place to leak."

Bounded stops a sequence from running to infinity.
Closed stops a sequence from leaking out through a missing boundary point.

Remove either and points can escape. The open interval $(0, 1)$ is bounded but not closed: the sequence $1/ k$ tries to converge to $0$ , but $0$ has leaked out. The set $[0, \infty)$ is closed but not bounded: the sequence $1, 2, 3, \dots$ runs away. Only when both walls are up does every sequence get cornered into a cluster point that stays inside.

The open-cover view says the same thing dually: if you try to tile a compact set with infinitely many small open patches, you always waste effort — finitely many already overlap to cover it. Non-compact sets defeat this: cover $(0, 1)$ by $(1/ n, 1)$ for $n = 2, 3, \dots$ ; no finite subfamily reaches the points near $0$ .

Worked Examples

The closed unit ball in $\mathbb{R}^3$ is compact

Given:

K = {x \in R^{3} : ∥ x ∥ \leq 1}

. Step 1 — bounded: Every

x \in K

satisfies

∥ x ∥ \leq 1

, so

M = 1

works in equation [3]. ✔ Step 2 — closed: The map

x \mapsto ∥ x ∥

is continuous, and

K = {x : ∥ x ∥ \leq 1}

is the preimage of the closed set

[0, 1]

, hence closed. If

x_{k} \in K

and

x_{k} \to x

, then

∥ x ∥ = lim ∥ x_{k} ∥ \leq 1

, so

x \in K

. ✔ Step 3 — apply Heine–Borel [5]: Closed and bounded in

R^{3} \Rightarrow

compact.

K = \overline{B} (0, 1) \subseteq R^{3} is compact.

(Contrast: the open ball $∥ x ∥ < 1$ is bounded but not closed, hence not compact — the sequence $x_{k} = (1 - 1/ k, 0, 0)$ converges to the boundary point $(1, 0, 0) \in /$ open ball.)

Extracting a convergent subsequence numerically

Given: the bounded sequence

x_{k} = sin (k)

k = 1, 2, 3, \dots

, all lying in

[- 1, 1]

. Goal: confirm Bolzano–Weierstrass produces a convergent subsequence and estimate a limit. Step 1 — boundedness:

∣ x_{k} ∣ = ∣ sin k ∣ \leq 1

, so the sequence lives in the compact set

[- 1, 1]

. By [6] a convergent subsequence exists. Step 2 — bisection in action: Split

[- 1, 1]

0

. Computing terms:

sin 1 \approx 0.841, sin 2 \approx 0.909, sin 3 \approx 0.141, sin 6 \approx - 0.279, sin 19 \approx 0.150, sin 22 \approx - 0.0089, sin 44 \approx 0.0177

. Infinitely many terms accumulate near

0

(whenever

k

is close to a multiple of

π

). Step 3 — identify a cluster point: Because

k mod π

is equidistributed (Weyl), the values

sin k

are dense in

[- 1, 1]

; in particular some subsequence

x_{k_{j}} \to 0

. Indices like

k = 3, 22, 333, 355, \dots

(good rational approximations to multiples of

π

) give

sin k_{j}

ever closer to

0

A subsequence x_{k_{j}} = sin (k_{j}) \to 0; indeed every L \in [- 1, 1] is a subsequential limit.

Common Misconceptions

"Closed and bounded always means compact." This is only true in finite-dimensional normed spaces. In an infinite-dimensional space (e.g.

ℓ^{2}

C [0, 1]

) the closed unit ball is closed and bounded but not compact. The standard basis vectors

e_{n} = (0, \dots, 0, 1, 0, \dots)

satisfy

∥ e_{n} ∥ = 1

and

∥ e_{n} - e_{m} ∥ = 2

for

n \neq = m

, so no subsequence is Cauchy — sequential compactness fails. Heine–Borel is a privilege of

R^{n}

. "Compactness is a property of the set alone." Compactness depends on the subspace topology but is intrinsic: a set is compact or not regardless of ambient space. However, closed and bounded are not intrinsic in the same way —

(0, 1)

is closed in itself yet not compact. Always check compactness via covers or sequences, not via "closed" applied to the wrong ambient space.

Total boundedness is essential, not mere boundedness

In a general metric space, bounded ≠ totally bounded. Take an infinite set $X$ with the discrete metric $d (x, y) = 1$ for $x \neq = y$ . Then $X$ has diameter $1$ (bounded) and is closed and complete. But the cover by singleton balls ${B (x, \frac{1}{2})} = {{x}}$ has no finite subcover when $X$ is infinite. So $X$ is bounded and complete yet not compact — it fails to be totally bounded. This shows why [6] upgrades "bounded" to "totally bounded" outside $R^{n}$ .

Connections

Compactness is the engine behind several pillars of analysis. Via Continuity, it gives the Extreme Value Theorem (continuous image of a compact set is compact, hence attains max/min) and Heine–Cantor uniform continuity. It underlies Uniform Convergence through Dini's theorem and the Arzelà–Ascoli criterion, which characterizes compact sets of functions via equicontinuity. In Metric Spaces it equals "complete + totally bounded"; in general Topological Spaces it is defined purely by open covers, splitting from sequential compactness. It feeds Connectedness (both are "global" topological invariants preserved by continuous maps) and supports Completeness of the Real Numbers, since the Nested Interval Property used in the proofs is itself a completeness axiom.

Real-World Applications

Optimization (Weierstrass Extreme Value Theorem): A continuous objective on a compact feasible region attains its global minimum — the existence guarantee behind every well-posed nonlinear program, e.g. minimizing energy of a constrained mechanical system on a closed bounded configuration set.
Numerical analysis: Convergence of fixed-point and subdivision algorithms relies on Bolzano–Weierstrass to extract convergent iterates from bounded sequences (e.g. bisection root-finding, branch-and-bound).
Differential equations (Peano existence theorem): Compactness via Arzelà–Ascoli proves existence of solutions to $y^{'} = f (t, y)$ with continuous $f$ , by extracting a convergent subsequence of approximate (Euler) solutions.
Control theory (Pontryagin maximum principle): Compactness of admissible control sets ensures optimal controls exist.
Economics (existence of equilibria): Brouwer/Kakutani fixed-point theorems, used to prove existence of Nash and Walrasian equilibria, require compact convex strategy/price simplices.
Spectral theory & quantum mechanics: Compact operators (limits of finite-rank operators) have discrete spectra accumulating only at $0$ — the mathematical reason atomic energy levels are quantized and countable.
Computer graphics & geometry: Compactness of closed bounded surfaces guarantees finite triangulations and that ray–surface intersection searches terminate.

Historical Development

1817 — Bernard Bolzano states and proves a version of the intermediate value theorem, implicitly using the least-upper-bound property and the cluster-point principle now called Bolzano–Weierstrass.
1865–1880s — Karl Weierstrass, in Berlin lectures, rigorously establishes that bounded sequences have convergent subsequences and that continuous functions on closed intervals attain extrema, popularizing $ε$ – $δ$ rigor.
1872 — Eduard Heine publishes results on uniform continuity, using the covering idea for closed bounded intervals (the seed of Heine–Borel).
1894–1895 — Émile Borel proves that a countable open cover of a closed bounded interval has a finite subcover, in his thesis on measure and function theory.
1900s — Henri Lebesgue and Pierre Cousin extend Borel's covering theorem to arbitrary (uncountable) covers; the result becomes the modern Heine–Borel theorem.
1906 — Maurice Fréchet introduces metric spaces and the general notion of compactness (compacité), framing sequential compactness abstractly.
1914 — Felix Hausdorff systematizes topological spaces; the open-cover definition of compactness gains its general home.
1923–1929 — Pavel Alexandrov and Pavel Urysohn develop bicompactness (today's "compactness") and prove key theorems (e.g. compactness via filters/nets later by Cartan, Bourbaki).
1930 — Andrey Tychonoff proves arbitrary products of compact spaces are compact (Tychonoff's theorem), the deepest general result, equivalent to the Axiom of Choice.

Subtleties & Limits

Several boundaries of compactness reveal deep structure rather than unsolved problems, but they remain conceptually subtle:

Compactness vs. sequential compactness diverge in general topological spaces. There exist compact spaces (e.g. $[0, 1]^{[0, 1]}$ , the product of continuum-many copies of $[0, 1]$ ) that are not sequentially compact, and sequentially compact spaces that are not compact (e.g. the first uncountable ordinal $[0, ω_{1})$ ). Only for metric spaces do the two coincide.

Tychonoff's theorem and the Axiom of Choice. The statement "every product of compact spaces is compact" is equivalent to the Axiom of Choice (Kelley, 1950). Restricting to Hausdorff factors weakens it to the (strictly weaker) Boolean Prime Ideal theorem. Thus the strength of compactness in infinite products is entangled with the foundations of set theory.

Characterizing compact sets in function spaces is delicate and ongoing in applications: the Arzelà–Ascoli (equicontinuity) and Kolmogorov–Riesz (in $L^{p}$ ) criteria solve special cases, but identifying compact subsets of more exotic spaces drives current functional analysis.

Compactness — Heine-Borel and Bolzano-Weierstrass

The Core Insight

Formal Statement

Open Cover and Compactness

Boundedness, Closedness, Sequential Compactness

Heine–Borel

Bolzano–Weierstrass

Why It Holds / Derivation

Bolzano–Weierstrass in $\mathbb{R}$ via bisection

Heine–Borel, both directions

Bisection argument: nested boxes shrink onto a single point, trapped inside one cover element $U$

Karl Weierstrass | 1815–1897

Building Intuition

Worked Examples

The closed unit ball in $\mathbb{R}^3$ is compact

Extracting a convergent subsequence numerically

Common Misconceptions

Total boundedness is essential, not mere boundedness

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also

Before this

Where this leads