The Bolzano-Weierstrass Theorem
Take any sequence of real numbers trapped between and . It need not converge. It might oscillate forever, wander erratically, or repeat patterns without settling down. Yet buried inside it, some pattern of terms must sneak up on a limit. This is the remarkable content of the Bolzano–Weierstrass theorem. Boundedness alone guarantees a convergent subsequence. No assumption of monotonicity or algebraic structure is needed. The result sits at the hinge between the algebraic and topological pictures of the real line. It converts a purely quantitative hypothesis into a qualitative conclusion. Boundedness is a statement about size. The conclusion concerns limiting behavior instead. This conversion is what makes real analysis work. It is the engine behind the Extreme Value Theorem. It also drives proofs that Cauchy sequences converge. It underlies the existence of limit points in compact sets. Without it, we could not guarantee a continuous function on a closed interval attains a maximum. Nor could we guarantee infinite decimal expansions correspond to genuine real numbers as expected. The big picture is that the real numbers are complete. There are no "holes" for sequences to fall through. This holds whenever they are confined to a bounded region. Bolzano and Weierstrass worked independently in the 19th century. They recognized that this completeness could be captured by one combinatorial idea: repeated bisection. This is exactly how we will prove it here. This article gives the precise statement. It offers a complete proof via the bisection (nested interval) method. This proof builds on the Monotone Convergence Theorem. It carefully discusses why boundedness cannot be dropped. Worked examples show how to extract convergent subsequences. These come from concrete oscillating sequences.
- Every bounded sequence of real numbers has a subsequence that converges.
- The proof uses repeated bisection to build a nested sequence of shrinking intervals, each containing infinitely many terms.
- The Nested Interval Property (a form of completeness of ) pins down a single point common to all the intervals; the subsequence converges to it.
- Boundedness is essential: the unbounded sequence has no convergent subsequence at all.
- The theorem is equivalent, in a precise sense, to the completeness of — it fails outright over .
- It underlies compactness of closed bounded sets, the Extreme Value Theorem, and the equivalence of Cauchy sequences with convergent sequences.
- Key idea: boundedness plus infinitely many terms forces infinite repetition near some point, and completeness of turns that repetition into an actual limit.
Where this lives today
The Bolzano–Weierstrass theorem is a load-bearing wall of real analysis, not an isolated curiosity. It is the standard tool for proving that every Cauchy sequence of reals converges (extract a convergent subsequence via Bolzano–Weierstrass, then show the whole Cauchy sequence must converge to the same limit) — see Cauchy Sequences and Completeness. It underlies the Extreme Value Theorem (a continuous function on attains a maximum): one takes a maximizing sequence, extracts a convergent subsequence via Bolzano–Weierstrass, and uses continuity to show the limit is where the maximum occurs. In topology, the theorem is the prototype for sequential compactness, and the fact that closed bounded subsets of are compact (the Heine–Borel theorem) is essentially a repackaging of Bolzano–Weierstrass. This compactness feeds directly into optimization theory, where guaranteeing that minimizers or maximizers exist over bounded feasible regions relies on exactly this sequential extraction argument — used constantly in economics, physics variational principles, and machine learning convergence proofs. In dynamical systems, bounded orbits are analyzed via their accumulation points (omega-limit sets), a direct descendant of Bolzano–Weierstrass reasoning: a bounded trajectory must have subsequential limits, and the structure of the set of all such limits governs long-term behavior. In numerical analysis, the theorem justifies that iterative algorithms confined to a bounded region have subsequences converging to candidate fixed points, a standard step in convergence proofs for optimization algorithms such as gradient descent variants and fixed-point iteration schemes. It also connects forward to the notions of Limit Superior and Limit Inferior, which can be defined precisely as the largest and smallest subsequential limits guaranteed to exist by this very theorem.
Ask the tutor: Can you show me step-by-step how to extract an explicit convergent subsequence from ?
Let be a sequence of real numbers.
Bounded. The sequence is bounded if there exists such that for all .
Subsequence. A subsequence of is a sequence of the form , where is a strictly increasing sequence of natural numbers.
Convergence. A sequence converges to if for every there exists such that for all . We write or . The Bolzano–Weierstrass theorem asserts: if is bounded, then there exists a subsequence and a real number such that .
Intuition
Picture a bounded sequence as an infinite swarm of points, all confined to some interval . Since there are infinitely many points but only a finite-length interval to hold them, the points cannot spread out evenly forever — they must crowd. The Bolzano–Weierstrass theorem says this crowding is not just visual intuition; it is mathematically inevitable and produces an actual convergent subsequence. The proof strategy mirrors a search technique: keep bisecting the interval, at each stage keeping the half that still contains infinitely many terms of the sequence (at least one half always must, since the whole is infinite and a finite union of two halves can't both be finite). This produces a nested sequence of shrinking intervals, each containing infinitely many terms, whose lengths shrink to zero. The Nested Interval Property — itself a consequence of the completeness of — guarantees these intervals converge on a single point . Because each interval still holds infinitely many terms, we can always find a later term of the sequence inside it, letting us build a genuine subsequence converging to .
Central theorem and proof
Let be a sequence of real numbers such that there exists with for all . Then there exists a subsequence and a real number such that
Technique: nested bisection combined with the Nested Interval Property. Since is bounded, all terms lie in the closed interval . Say an interval "contains infinitely many terms of the sequence" if the set is infinite.
Step 1: Construct a nested sequence of intervals. We build closed intervals , each containing infinitely many terms of the sequence, with . Base case: contains all terms of the sequence (infinitely many, since the index set is infinite). Inductive step: suppose has been constructed and contains infinitely many terms. Let be its midpoint, and split into
The index set is infinite by the inductive hypothesis, and
This is a union of two sets whose union is infinite. If both were finite, their union would be finite (a finite union of finite sets is finite), contradicting that is infinite. Hence at least one of the two sets is infinite. Define to be whichever of has infinitely many terms of the sequence in it (if both do, choose the left one, say, to fix a convention). By construction and
This completes the inductive construction of a nested sequence of closed bounded intervals with , each containing infinitely many terms of the sequence.
Step 2: Apply the Nested Interval Property to obtain a limit point . Write . The sequence is nondecreasing (since forces ) and bounded above by . By the Monotone Convergence Theorem, converges to some limit ; explicitly,
which exists because is a nonempty set bounded above, and the supremum exists by the completeness (least upper bound property) of . We check for every . Fix . For every we have (monotonicity) and (since for ), so for all ; taking (using ) gives , i.e. . Since was arbitrary,
(This intersection is in fact a single point, since : if both belonged to every then , forcing . We only need for what follows.)
Step 3: Construct the subsequence converging to . We choose indices recursively so that for every . Since contains infinitely many terms of the sequence, the index set is infinite, hence nonempty; choose any . Suppose have been chosen with for . The set is infinite (by construction of ), so in particular it is not contained in the finite set ; choose with . This is possible precisely because an infinite set of natural numbers cannot be a subset of a finite initial segment . This recursively defines a strictly increasing sequence of indices with for every .
Step 4: Show . Fix . Since and , and has length , we get
Since as (this follows because , a standard fact provable by induction and the Archimedean property), choose so large that ; then for all ,
Hence . Since , we also have , completing the proof.
∎This proof uses only: the Archimedean property, the least upper bound property of (via the Monotone Convergence Theorem), and elementary combinatorics of finite versus infinite sets. It is non-circular: nowhere does it assume convergent subsequences exist or invoke compactness — it builds the convergent subsequence from scratch.
Every bounded sequence in has a convergent subsequence, where convergence and boundedness are with respect to the Euclidean norm.
Technique: iterate the 1-dimensional theorem coordinate by coordinate. Let be a bounded sequence in , , with for all . Since for each coordinate , each coordinate sequence is a bounded real sequence. Apply the theorem to the first coordinate sequence : obtain a subsequence indexed by with . Now the second-coordinate sequence restricted to these indices, , is again bounded; apply the theorem again to extract a further subsequence (indices , a subsequence of the ) along which the second coordinate converges to some — and, since it's a subsequence of a convergent sequence, the first coordinate still converges to along these indices (subsequences of convergent sequences converge to the same limit). Iterating this times (finitely many steps) produces a single subsequence along which every coordinate converges, to limits . Convergence in each coordinate is equivalent to convergence in the Euclidean norm to , since
∎
Worked examples
Example 1. Consider the sequence
So , , , , , , and so on. Since for all , we have , so the sequence is bounded (take ). The sequence does not converge: the even-indexed terms increase toward , while the odd-indexed terms decrease toward ; these are two different accumulation behaviors, so the whole sequence has no single limit (formally: if then every subsequence converges to , but and are two different subsequential limits, a contradiction). Bolzano–Weierstrass guarantees some convergent subsequence exists, and indeed we can exhibit two:
Both are valid convergent subsequences, illustrating that the theorem promises existence, not uniqueness, of a convergent subsequence — different subsequences may converge to different limits.
Example 2. Let be an enumeration of the rational numbers in (such an enumeration exists since is countable). Concretely, list them as
(all fractions in lowest terms with increasing denominators). This sequence is bounded ( for all ), but it has no limit at all — it jumps around visiting every rational, never settling. We are guaranteed a convergent subsequence. Let's construct one converging to , an irrational number not among the 's values as a limit reached in finitely many steps, but approximable arbitrarily well: for each , since the rationals are dense in , there are infinitely many with (density means every interval around , however small, contains infinitely many terms of any enumeration of a dense set — in particular infinitely many terms of , since only finitely many rationals in have denominator below any bound, but infinitely many rationals lie in each such small interval). Concretely, pick with , then with , and so on, at each stage using that infinitely many indices remain available (exactly the bisection argument's Step 3 logic, applied directly instead of via intervals). This produces . This example shows concretely why the proof method (bisection trapping infinitely many terms) is really necessary — no algebraic trick isolates a convergent piece of such an erratic sequence; only the pigeonhole/infinitude argument does.
Consider the sequence for , which is unbounded: for every , there is a term () exceeding .
Claim: has no convergent subsequence.
Proof of claim. Suppose for contradiction were a subsequence converging to some . Convergent sequences are bounded: choosing , there is with for all , so for , and the finitely many terms are individually bounded, so is a bounded sequence. But (since are distinct positive integers, so ), forcing , contradicting boundedness. This shows the hypothesis of boundedness in the Bolzano–Weierstrass theorem is not a technical convenience — it is essential. Every step of the bisection proof breaks down without it: Step 1 cannot even begin, since there is no finite starting interval containing all the terms.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| Sequence bounded, does not converge | Guaranteed: at least one convergent subsequence exists (theorem applies) |
| Sequence unbounded | Theorem does not apply; may have no convergent subsequence at all (e.g. ) |
| Sequence unbounded but with a bounded subsequence | A convergent subsequence can still exist, e.g. if odd, if even — theorem doesn't apply to the whole sequence, but a bounded piece may still converge |
| Sequence already convergent | Every subsequence converges to the same limit; theorem's conclusion is automatic and not very informative |
| Working over instead of | Fails: e.g. rational truncations of are bounded but no subsequence converges to a rational number, and has no limit for it |
| Sequence in | Holds, proved by applying the 1-D theorem coordinate-by-coordinate (Corollary above) |
| Infinite-dimensional spaces (e.g. ) | Fails in general — bounded sequences need not have convergent subsequences; this is why finite dimension matters |
The mathematician behind it
Origins · 1 minBernard Bolzano and how this was discovered
A priest, philosopher, and mathematician working largely in isolation in Prague under Austrian political censorship (his writings on religion and social reform led to his dismissal from his university post in 1819). Bolzano anticipated much of rigorous real analysis decades before it became mainstream: he gave an early proof-sketch of what we now call the Bolzano–Weierstrass theorem in an 1817 manuscript on the Intermediate Value Theorem, and constructed one of the first examples of a continuous nowhere-differentiable function, though this work remained largely unpublished and unknown to his contemporaries until much later.
Does the Bolzano–Weierstrass theorem tell us the whole sequence converges?
No. It only guarantees the existence of some subsequence that converges; the original sequence may not converge at all. A classic example is , which is bounded but oscillates between values approaching and , so it has no limit itself, even though the even-indexed and odd-indexed subsequences each converge (to and respectively). The theorem is purely an existence statement about some subsequence, not a convergence statement about the whole sequence. To conclude the whole sequence converges, you additionally need every subsequence to share the same limit, or equivalently that the sequence is Cauchy.
Why does boundedness matter so much — can't we just take a "limit at infinity"?
Boundedness prevents the sequence from escaping to , which would make convergence to a finite real number impossible for any subsequence. If , every subsequence also diverges to , since . There is no finite region to which the bisection argument can confine infinitely many terms, so the entire proof strategy collapses at its very first step. Boundedness is precisely the hypothesis that guarantees a finite starting interval containing infinitely many (indeed, all) terms, which is where the whole bisection machine begins.
Is the converse of the theorem true — does having a convergent subsequence imply the whole sequence is bounded?
No, and this converse is false. Consider if is odd, and if is even. This sequence is unbounded (the odd terms grow without bound), yet the even-indexed subsequence converges. So a convergent subsequence can coexist with an unbounded overall sequence. The correct logical relationship is one-directional: bounded (some subsequence converges), but the reverse implication does not hold.
How does this theorem relate to Cauchy sequences?
Bolzano–Weierstrass is the crucial engine in proving that every Cauchy sequence of reals converges (i.e., that is complete in the Cauchy sense). Given a Cauchy sequence, one first shows it is bounded (a short direct argument from the Cauchy condition), then applies Bolzano–Weierstrass to extract a convergent subsequence with limit . A final argument — using the Cauchy property to control the gap between any term and terms far out in the convergent subsequence — shows the whole sequence converges to , not just the subsequence. This is exactly the bridge to Cauchy Sequences and Completeness.
Does the theorem hold for sequences of complex numbers?
Yes. A bounded sequence of complex numbers , meaning for all , has a convergent subsequence. The proof follows the approach: apply Bolzano–Weierstrass to the real parts to extract a subsequence along which converges, then apply it again to the imaginary parts along that subsequence to extract a further subsequence along which both real and imaginary parts converge. This is a special case of the corollary with , since is isomorphic to as a metric space.
Why does the theorem fail in infinite-dimensional spaces like ?
In infinite dimensions, boundedness no longer forces "crowding." Consider the standard basis sequence in (the -th coordinate is , all others ). Each has norm , so the sequence is bounded, but for all , so no subsequence can be Cauchy, and hence none converges. This shows the Bolzano–Weierstrass property is special to finite-dimensional spaces (or more generally, to compact sets); it is intimately tied to the Heine–Borel characterization of compactness, which also fails in infinite dimensions.
What's the fastest way to remember the proof?
Bisect, keep the infinite half, repeat forever; the shrinking intervals trap a unique limit point by completeness, and you can always find sequence terms deeper and deeper inside because each interval still holds infinitely many terms. In one line: boundedness gives a starting box; infinitude of the index set guarantees you never run out of terms to chase into ever-smaller sub-boxes; completeness (via nested intervals or the Monotone Convergence Theorem) hands you the limit.