Cauchy Sequences and Completeness
Suppose a sequence of rational numbers gets tighter together, term after term. Yet you cannot name the limit. It happens to be irrational. Does the sequence still "converge"? This question exposes a subtlety hiding inside the very idea of a limit. The definition of convergence requires knowing the limit in advance. But often we only know that terms are clustering. Cauchy sequences solve this problem. They define a notion of "clustering" that refers only to the terms themselves. It never refers to a limit. The remarkable fact — and the centerpiece of this article — is this. In the real numbers, this internal clustering condition is equivalent to convergence. This equivalence is not free. It is precisely where the completeness of enters analysis. This is what distinguishes from . A sequence of rationals can be Cauchy without converging to a rational number. But every Cauchy sequence of reals converges to a real number. This single theorem — the Cauchy Criterion — lets us prove a sequence converges. We never need to exhibit its limit. The idea reaches far beyond a technical curiosity. It underlies the construction of itself from (as equivalence classes of Cauchy sequences). It is the standard tool for proving convergence of series and iterative algorithms. It also generalizes to the notion of a complete metric space. This concept is indispensable in functional analysis, differential equations, and numerical methods. This article gives the precise definition of a Cauchy sequence. It proves the Cauchy Criterion for in full rigor. This uses the Bolzano-Weierstrass Theorem. It also shows, with an explicit counterexample, why completeness of the ambient space cannot be dropped. It previews how this machinery feeds directly into the Cauchy Criterion for Series. It also connects to the theory of Limit Superior and Limit Inferior.
- A sequence is Cauchy if its terms eventually become arbitrarily close to each other, not just to some fixed limit.
- Every convergent sequence (in any metric space) is automatically Cauchy — this direction is easy and needs no completeness.
- In , the converse also holds: every Cauchy sequence converges. This is the Cauchy Criterion, and it fails in .
- The proof of the converse combines boundedness of Cauchy sequences with Bolzano-Weierstrass Theorem to extract a convergent subsequence, then shows the whole sequence must converge to the same limit.
- "Cauchy" is a completeness-free, self-contained test for convergence — useful exactly when you cannot guess the limit.
- The definition generalizes verbatim to any metric space, where completeness becomes the defining property of spaces (like , or Banach spaces) where the equivalence still holds.
- Key idea: Convergence and the Cauchy property coincide in , and this equivalence is what "completeness" means.
Where this lives today
The Cauchy criterion is the working definition of convergence whenever an explicit limit is unavailable. In numerical analysis, iterative root-finding and fixed-point methods (Newton's method, as in Example 1) are proven to converge by showing the iterates form a Cauchy sequence, which is often far easier than guessing the exact limit. In the theory of series, the Cauchy Criterion for partial sums underlies tests like the Cauchy Criterion for Series and the ratio/root tests. In functional analysis, Banach spaces are defined exactly as normed vector spaces that are complete with respect to their norm — Cauchy sequences of functions converge to functions in the same space — which is the bedrock of the existence theory for differential equations (Picard iteration) and of Fourier analysis. In probability theory, "Cauchy in probability" or "Cauchy almost surely" versions of this concept underlie almost-sure convergence theorems for martingales and random series. In computer science and cryptography, Cauchy-sequence-style arguments justify convergence of iterative algorithms (gradient descent, fixed-point iteration in cryptographic protocols) without needing closed-form limits, and -adic number systems in cryptography are literally built, like itself, as completions of with respect to a different (non-Archimedean) metric — the same completion machinery pioneered by the real-number construction from Cauchy sequences.
Ask the tutor: Can you show me how the Cauchy Criterion is used to prove the Ratio Test for series convergence?
Let be a sequence of real numbers. We say is a Cauchy sequence if for every there exists such that for all ,
Equivalently: for every , all but finitely many terms of the sequence lie within an interval of length of each other, i.e. the tail has diameter at most . (The same definition applies verbatim in any metric space , replacing with . A metric space in which every Cauchy sequence converges is called complete.)
Intuition
Ordinary convergence says: pick any tolerance , and eventually every term is within of the target . This definition needs as an input. The Cauchy condition instead compares terms to each other: eventually, any two terms (however far apart in index) are within of each other. It's a statement purely about the internal geometry of the sequence, with no reference to an external point. Picture the sequence as a cloud of points on the number line, indexed by time. Convergence says the cloud collapses onto a single point . The Cauchy condition says the cloud's diameter shrinks to zero as time goes on — the points bunch together, but a priori we don't know they're bunching around any particular real number. The theorem below says: on the real line, a shrinking-diameter cloud of points must be collapsing onto some point, and that point is a real number. This fails on because the "hole" the cloud collapses toward might not be a rational number — the cloud shrinks in diameter, but there's no rational point at its center.
The main results
Every Cauchy sequence of real numbers is bounded: there exists such that for all .
Apply the definition of Cauchy with : there exists such that for all , . In particular, taking , for all ,
So every term with index is bounded by . The remaining finitely many terms are each individually a fixed real number, hence bounded by (an empty max, if , is vacuously not needed). Set
Then for every .
∎If is a sequence of real numbers that converges to a limit , then is a Cauchy sequence.
Let . Since , applying the definition of convergence with tolerance , there exists such that for all ,
Now let . By the triangle inequality,
Since was arbitrary, satisfies the Cauchy condition.
∎A sequence of real numbers converges (to some real number) if and only if it is a Cauchy sequence.
() This is exactly the previous theorem, Convergent implies Cauchy.
() Suppose is Cauchy. We must produce a real number with . The proof technique is: bound the sequence, extract a convergent subsequence via Bolzano-Weierstrass Theorem, then show the whole sequence converges to that subsequential limit using the Cauchy property to control the gap. Step 1 (boundedness). By the theorem Cauchy sequences are bounded, is bounded. Step 2 (extract a convergent subsequence). Since is a bounded sequence of real numbers, the Bolzano-Weierstrass Theorem guarantees a subsequence that converges to some . Step 3 (the whole sequence converges to ). Let . We must find such that . Since is Cauchy, choose such that for all ,
Since , choose such that for all ,
Because the indices form a strictly increasing sequence of natural numbers, for all (an elementary induction: , and if then since and both are integers, ). Hence we may choose a single index with (possible since as ). Set . Let . Using the fixed index together with , inequality (1) gives
Since , inequality (2) gives
By the triangle inequality,
Since was arbitrary and depends only on (not on ), this proves .
∎A sequence of real numbers diverges if and only if there exists such that for every there exist with .
This is the logical negation of the Cauchy condition, combined with the Cauchy Criterion: converges iff it is Cauchy, so diverges iff it is not Cauchy, i.e. iff
which by moving the negation through the quantifiers (flipping and to ) is exactly
Worked examples
Example 1 (proving convergence without knowing the limit). Define recursively by
This is Newton's method approximating . We show is Cauchy directly from the recursion, without assuming we know is the limit. First, , and if then ; by induction for all . Next, for ,
so for every , i.e. for all . Now for ,
using . So is monotone decreasing and bounded below by ; in particular it's bounded. We can go further and show it is Cauchy using a quantitative estimate. From (a direct algebraic identity: expand ), and since for ,
With , so (since ), a quick induction shows doubly-exponentially fast, so certainly as : the sequence is Cauchy. By the Cauchy Criterion, converges to some real ; passing to the limit in the recursion gives , and since , . The point of this example: we established convergence (via the Cauchy property, monotonicity and boundedness together) before pinning down that the limit is — exactly the situation where the Cauchy criterion is essential, since was not given to us in advance as a number to test against.
Example 2 (a divergence proof via the contrapositive). Let (the harmonic partial sums). We show is not Cauchy, hence diverges, using the corollary above. Take . Given any , set and . Then
This sum has exactly terms, each term is (since ), so
Thus for every we exhibited with . By the contrapositive corollary, is not Cauchy, and therefore (by the Cauchy Criterion) diverges. This reproves the classical fact that the harmonic series diverges, and directly foreshadows the Cauchy Criterion for Series, which restates exactly this test in terms of partial sums.
The forward direction (convergent Cauchy) used no special property of ; it holds in any metric space. The reverse direction — Cauchy convergent — genuinely used completeness of (via Bolzano–Weierstrass). To see this hypothesis cannot be dropped, work inside the metric space (with the usual absolute-value metric), which is not complete. Define by truncating the decimal expansion of :
so is the decimal expansion of truncated after digits past the decimal point. Each . This sequence is Cauchy in . For , and agree in their first decimal digits by construction, so (truncating further digits changes the value by less than one unit in the -th decimal place). Given , choose with (possible by the Archimedean property); then for , . So satisfies the Cauchy condition, using only the metric on . This sequence does not converge in . Suppose toward contradiction for some . Viewing as a sequence of real numbers, the same estimate shows converges in (it is Cauchy in , and is complete by the theorem above) to the unique real number whose decimal expansion is , namely . Limits in are unique, so if with , uniqueness forces . But is irrational (the standard proof: if in lowest terms then forces both even, contradicting lowest terms) — contradiction, since was assumed rational. Hence is a Cauchy sequence in the metric space that has no limit in . This shows the reverse implication of the Cauchy Criterion fails when the ambient space () is not complete — precisely the hypothesis "completeness of " (encoded in our proof through the Bolzano–Weierstrass theorem, which itself rests on the least upper bound property of ) that was used essentially in Step 2 of the proof above.
Scope, edge cases & common traps
| Situation | What holds | What can fail |
|---|---|---|
| Sequence in | Cauchy convergent | — |
| Sequence in | Convergent Cauchy always | Cauchy convergent (in ) |
| Sequence in a general metric space | Convergent Cauchy always | Cauchy convergent only if space is complete |
| Checking finitely many | Irrelevant | Definition needs all simultaneously, not just consecutive terms |
| Necessary for Cauchy | Not sufficient — does not imply Cauchy (see below) |
The mathematician behind it
Origins · 1 minAugustin-Louis Cauchy and how this was discovered
Cauchy was one of the principal architects of modern rigorous calculus, formalizing limits, continuity, and convergence with the -style arguments used throughout analysis today. His 1821 Cours d'Analyse introduced what we now call the Cauchy criterion for convergence of sequences and series, replacing informal 18th-century reasoning about infinitesimals with precise inequalities. He also made foundational contributions to complex analysis (Cauchy's integral theorem), differential equations, and elasticity theory, publishing an extraordinary volume of work — over 800 papers — across nearly every branch of mathematics and mathematical physics of his time.
What exactly is the difference between "convergent" and "Cauchy"?
Convergent means there is a specific real number such that terms get arbitrarily close to ; the definition explicitly references . Cauchy means terms get arbitrarily close to each other, with no reference to any particular target value. In , the Cauchy Criterion proves these are logically equivalent notions, so in practice "Cauchy" is often used precisely when you want to establish convergence without first knowing (or being able to compute) what the limit is. In general metric spaces they are not equivalent: convergent always implies Cauchy, but Cauchy implies convergent only if the space is complete.
Why does the proof need Bolzano–Weierstrass rather than something simpler?
The Cauchy condition alone only tells you the terms cluster together; it says nothing directly about where they cluster. Bolzano–Weierstrass guarantees that any bounded sequence in has a convergent subsequence, which supplies a candidate limit . The rest of the proof (Step 3) is the genuinely Cauchy-specific argument: it uses the Cauchy property to show that because all terms eventually bunch within of each other, and infinitely many of them (the subsequence) bunch within of , the entire tail must be within of . Both ingredients are necessary; neither alone suffices.
Is every bounded sequence Cauchy?
No. Boundedness is necessary for a Cauchy sequence (we proved this), but it is far from sufficient. The sequence is bounded (between and ) but not Cauchy: taking , for any we can pick consecutive with . This sequence oscillates forever and never settles down, so it is bounded but neither Cauchy nor convergent — it has two different subsequential limits, and , which by the theorem's Step 3 argument (uniqueness of the limit target) already rules out convergence, hence rules out being Cauchy.
Does the Cauchy Criterion give a way to compute the limit?
No — and that is precisely its value. The Cauchy Criterion is an existence theorem: it certifies that a real number exists such that , without constructing or naming . This is exactly what makes it useful for cases like Example 1, where establishing convergence first (via Cauchy-ness, or via monotone + bounded arguments) is a separate step from later identifying the limit (e.g., by passing to the limit inside a recursive formula, or via other structural facts).
How does this relate to the construction of the real numbers themselves?
One standard construction of (due to Cantor, Heine, and Méray) builds real numbers directly as Cauchy sequences of rationals, where two Cauchy sequences and are declared equivalent if . Each equivalence class is defined to be a "real number." Under this construction, the fact that (built this way) is complete becomes a theorem to prove, and the Cauchy Criterion in this article can be viewed as the statement, once is constructed via the least-upper-bound property instead, that both constructions agree.
Does the Cauchy criterion generalize to sequences of functions or vectors?
Yes. In (with the Euclidean metric) the identical statement holds: Cauchy sequences of vectors converge, because is complete (this follows by applying the one-dimensional Cauchy Criterion coordinatewise). In spaces of functions, "Cauchy in the sup-norm" sequences of continuous functions converge uniformly to a continuous function precisely because the space of bounded continuous functions with the sup norm is a complete metric space (a Banach space). This generalization is the entire basis for existence proofs via Picard iteration and for foundational results in Fourier series and PDE theory.
What is the relationship to the Cauchy Criterion for Series?
A series converges exactly when its sequence of partial sums converges, so applying the Cauchy Criterion to directly yields the Cauchy Criterion for Series: converges iff for every there is such that for all , . Example 2's divergence proof for the harmonic series is a direct instance of this specialization.