The Cauchy Criterion for Uniform Convergence
Suppose you are handed a sequence of functions . You are asked whether it converges uniformly. But you have no candidate limit function to test against. Checking the definition of Uniform Convergence directly seems to require already knowing the answer . That definition speaks of . This is exactly the obstruction that the ordinary Cauchy criterion resolves for sequences of numbers. It lets you certify convergence of a sequence in using only the terms themselves. The limit itself is never needed. The question this article answers is whether the same trick works one level up. Does it work for sequences of functions converging uniformly? The answer is yes. The mechanism is the same completeness phenomenon that makes itself work. We introduce the uniform Cauchy condition: for every there is an such that for all . The Cauchy Criterion for Uniform Convergence asserts something important. A sequence of real-valued functions on a set converges uniformly on if and only if it satisfies this condition. This single equivalence is the load-bearing wall behind an enormous amount of analysis. It is the quiet reason the Weierstrass M-Test works. It is the reason spaces of bounded or continuous functions equipped with the sup-norm are complete metric spaces. It is the reason we can build functions as limits of sequences we can only partially control. Examples include the Weierstrass nowhere-differentiable function, or solutions of differential equations via Picard iteration. The deep idea is that uniform convergence is really convergence in a metric space. This space consists of bounded functions with the metric . This metric space is complete. Completeness of a metric space means precisely that Cauchy sequences converge. So the Cauchy criterion for uniform convergence is nothing but the completeness of this function space. That completeness is inherited from the completeness of . Seeing it this way turns a seemingly ad hoc - statement into something more. It becomes an instance of a single unifying principle. This article gives the precise definitions. It proves the equivalence in full, using only the completeness of and basic Cauchy-sequence facts. It works two concrete asymmetric examples. It shows what fails without completeness of the codomain. Finally, it connects the result forward to the tools that make it practically indispensable — the M-test and term-by-term integration.
- The uniform Cauchy condition says as , with no reference to a limit function.
- The Cauchy Criterion states: converges uniformly on is uniformly Cauchy on .
- The proof builds the limit pointwise (using completeness of ), then upgrades pointwise to uniform convergence.
- This is exactly completeness of the sup-norm space of bounded functions — Cauchy sequences of functions converge there.
- It certifies uniform convergence without ever naming the limit function, which is essential for the Weierstrass M-Test.
- Key idea: uniform convergence of functions is convergence in a complete metric space, so it obeys its own Cauchy criterion.
Where this lives today
The uniform Cauchy criterion is the engine inside the Weierstrass M-Test: to show converges uniformly, one bounds with , and the tail estimate is exactly what makes the partial sums uniformly Cauchy — precisely the pattern used in Example 1 above. It also underlies why term-by-term integration and differentiation of uniformly convergent series are valid, a cornerstone of real analysis courses covering power series and Fourier series. In functional analysis, the corollary that (and its close relatives , the continuous bounded functions, and , bounded sequences) are complete under the sup-norm is the first example of a Banach space, the setting for the entire theory of normed vector spaces used throughout PDE theory, numerical analysis, and quantum mechanics (where state spaces are complete normed or inner-product spaces). The existence-and-uniqueness theorem for ordinary differential equations (Picard–Lindelöf) constructs its solution as the uniform limit of a Cauchy sequence of approximations, verified using exactly this criterion. In numerical analysis, error bounds for approximating a function by a sequence (splines, Fourier partial sums, neural-network approximants under uniform norm) are typically phrased as uniform Cauchy estimates, since one rarely knows the true limiting function in closed form — mirroring Example 1 exactly. In cryptography and complexity theory, uniform approximation bounds for functions (e.g. in constructing pseudorandom generators or in analyzing Boolean function approximation) also implicitly rely on completeness of the relevant function space to guarantee that Cauchy approximation schemes actually converge to a genuine limiting object.
:::quiz[In Example 2, on , what is ?]
- ✓
- It depends on and grows without bound
Ask the tutor: How does the uniform Cauchy criterion get used inside the proof of the Weierstrass M-Test, step by step?
Let be a nonempty set and let for be a sequence of functions. The sequence is called uniformly Cauchy on if for every there exists such that
Equivalently: for every there is such that for all simultaneously, whenever . Recall that converges uniformly on to a function if for every there is such that implies .
Intuition
Think of each function as a point in a very large space — the space of all bounded functions — where the "distance" between two functions and is
the largest vertical gap between their graphs. A sequence of functions converging uniformly is just a sequence of points converging in this metric: eventually every lies within a thin horizontal "tube" of radius around the limit function's graph, uniformly across the whole domain. The uniform Cauchy condition asks something more modest and checkable: that the functions eventually get close to each other (all graphs squeezed into a tube of width around one another), not close to some already-known target. The proof that these two notions coincide mirrors exactly why is complete: at each fixed point , is an ordinary Cauchy sequence of real numbers, so it converges by completeness of ; this manufactures a candidate limit function pointwise. The real work is then showing the convergence is not just pointwise but uniform — that the same works for every at once, which follows by letting inside the uniform estimate.
Let be a nonempty set and let , , be a sequence of real-valued functions on . Then converges uniformly on (to some function ) if and only if is uniformly Cauchy on .
We prove both directions. The technique is: () a direct triangle-inequality estimate; () construction of the limit via completeness of pointwise, followed by a uniform estimate obtained by passing to a limit inside an inequality.
() Uniform convergence implies uniformly Cauchy. Assume uniformly on . Let . By the definition of uniform convergence applied to , there exists such that for all ,
Now let and let be arbitrary. By the triangle inequality for absolute value,
Since , the first term is . Since , the second term is . Hence for every ,
Since was arbitrary, this bound holds for all , so
or more simply, taking in place of at the start of the argument yields a strict bound; in any case for all we have , and since was arbitrary this shows is uniformly Cauchy on . (To get a strict inequality with the exact originally given, simply run the argument with in each of the two applications of uniform convergence; the supremum of the sum is then .)
() Uniformly Cauchy implies uniform convergence. Assume is uniformly Cauchy on . We construct the limit function in two steps. Step 1: Pointwise limit exists. Fix . We claim is a Cauchy sequence of real numbers. Given , uniform Cauchyness gives such that for all ,
In particular, taking ,
This is precisely the statement that is a Cauchy sequence in . By the Completeness Axiom of (every Cauchy sequence of real numbers converges), converges to some real number, which we call . Since was arbitrary, this defines a function by
By construction, pointwise on . Step 2: The convergence is in fact uniform. Let . By uniform Cauchyness applied to , there exists such that
Fix any and fix any . For every we then have, in particular,
This is a fixed inequality (for fixed ) holding for all ; we let . Since by Step 1, and since the absolute value function is continuous, we get
(Here we used the standard fact that a non-strict inequality persists in the limit: if for all and , then ; this is proved directly from the definition of limit and does not depend on the theorem being proved.) This inequality was derived for an arbitrary , using only (with depending on alone, not on ). Hence
Since was arbitrary, this is exactly the statement that uniformly on . Both directions are established, completing the proof.
∎Let be a nonempty set and let denote the set of all bounded functions , equipped with the sup-norm metric . Then is a complete metric space: every Cauchy sequence in this metric converges (in this metric) to an element of .
Let be a Cauchy sequence in ; that is, for every there is with for all . This is exactly the uniform Cauchy condition. By the theorem just proved, converges uniformly on to some function , meaning . It remains to check , i.e. is bounded. Take ; there is with , i.e. for all . Since is bounded, say for all , the triangle inequality gives for all . Hence is bounded, so , and in this space. Thus every Cauchy sequence in converges in , proving completeness.
∎Worked examples
Example 1 (certifying uniform convergence without knowing the limit in closed form). Define, for ,
This partial-sum sequence has no elementary closed form for its limit, yet we can prove uniform convergence on via the uniform Cauchy condition, and this is exactly the mechanism underlying the Weierstrass M-Test. For ,
For , and , so each term is bounded:
Hence, for all simultaneously,
This bound is independent of and of (for ), and it tends to as since . Given , choose so large that (possible since ). Then for all (and trivially for , where the difference is ),
So is uniformly Cauchy on . By the theorem, converges uniformly on to some function — even though we never wrote in closed form. This is the general pattern of the Weierstrass M-test: bounding each term by a constant with makes the tail of the series a uniformly small Cauchy tail.
Example 2 (a sequence that is pointwise Cauchy but fails to be uniformly Cauchy, hence fails to converge uniformly). Define by
First, pointwise: for each fixed , if and if . So for (since ) and . Thus pointwise on all of , and in particular is a Cauchy sequence of real numbers for each fixed (being convergent). Now test whether is uniformly Cauchy, equivalently (by the theorem, contrapositive) whether it converges uniformly to the pointwise limit . Compute . Let as ranges over ; then , maximized at giving value . Since does attain the value for , the supremum is attained:
So need not even be checked against a limit — we directly see for every , so uniformly (the sup-distance to the pointwise limit never shrinks below ). By the contrapositive of the theorem (uniform convergence uniformly Cauchy), cannot be uniformly Cauchy either — let's verify this directly to see the failure concretely. Take : at we have . What is ? Here , so . Then
a fixed positive number not depending on . Hence for every , so the uniform Cauchy condition fails (taking , no works, since and always violate it). This matches the theorem exactly: pointwise-Cauchy-everywhere is not enough; uniform convergence fails, and correspondingly the uniform Cauchy condition fails.
The theorem relies on completeness of (used in Step 1 of the () direction, to produce the pointwise limit). If we replace the codomain by an incomplete metric space, the implication "uniformly Cauchy uniformly convergent" can fail entirely, because there may be no limit function to converge to. Let be a single point (so uniform and pointwise convergence coincide trivially, isolating the codomain's role), and let the codomain be with its usual metric, instead of . Define where is a sequence of rationals converging in to , e.g. the truncated decimal expansions
Since has one point, , and is Cauchy in (indeed in , since it converges there). So is uniformly Cauchy as a sequence of functions . But there is no function with uniformly (equivalently, here, at all), because that would require with , while in fact , and limits in a metric space are unique — so no rational number can be the limit. The uniform Cauchy condition holds, yet uniform convergence to a function valued in fails. The single hypothesis that broke was completeness of the codomain ( is not complete), which was silently used when we invoked completeness of to build . This is precisely why the theorem is stated for (or more generally into any complete metric space), not into an arbitrary metric space.
Scope, edge cases & common traps
| Situation | What holds | What can fail |
|---|---|---|
| , uniformly Cauchy | Uniform convergence to some (theorem) | — |
| (incomplete codomain), uniformly Cauchy | Cauchy in the sup-metric | Limit may not exist in (see counterexample) |
| Cauchy for each fixed (pointwise Cauchy only) | Pointwise limit exists | Convergence to may fail to be uniform (Example 2) |
| continuous, uniformly Cauchy | Limit is continuous (uniform limit of continuous is continuous) | Nothing extra needed beyond the theorem plus the continuity-transfer theorem |
| infinite domain, no boundedness assumed on | Theorem still holds verbatim (no boundedness of required) | Do not confuse with completeness of , which is about bounded functions specifically |
The mathematician behind it
Origins · 1 minAugustin-Louis Cauchy and how this was discovered
Cauchy was among the founders of rigorous analysis, responsible for the -based definitions of limit, continuity, and convergence that replaced the looser 18th-century treatment of infinitesimals. His name attaches to the criterion for convergence of sequences of numbers — the ancestor of the uniform Cauchy condition treated here — as well as to foundational results in complex analysis, ordinary differential equations, and elasticity theory. The extension of his convergence criterion from sequences of numbers to sequences of functions, and the recognition that uniform convergence is the right notion for such an extension, emerged over the following decades through the work of Weierstrass and others who sharpened the distinction between pointwise and uniform behavior that Cauchy's own era had not yet fully separated.
Why can't we just define uniform convergence using the Cauchy condition from the start, skipping the limit-based definition?
You can, and in fact many texts introduce the uniform Cauchy condition specifically because it avoids reference to a limit function. But logically the two definitions (limit-based uniform convergence, and the uniform Cauchy condition) are a priori different statements, and the content of this article's theorem is precisely that they coincide. Pedagogically, the limit-based definition is usually given first because it directly generalizes the single-function limit concept, while the Cauchy criterion is presented as a derived, highly useful equivalent — much as with sequences of real numbers, where "converges" is defined via a limit and "Cauchy" is proved to be equivalent, not simply declared to be the definition.
Does the theorem require the functions to be continuous, differentiable, or bounded?
No. The theorem as stated holds for an arbitrary sequence of functions on an arbitrary nonempty set , with no continuity, differentiability, or boundedness assumptions on the individually. The corollary about completeness of does restrict to bounded functions, but that is only to keep the resulting sup-norm finite so that forms a genuine normed space; the underlying Cauchy criterion theorem itself needs no such restriction, since suprema of are allowed to be in the general statement (though the hypothesis that they eventually fall below any forces them to be finite for large indices anyway).
How does this relate to the ordinary Cauchy criterion for sequences of real numbers?
It is a direct generalization. Think of a sequence of numbers as a sequence of constant functions on any fixed set ; then , and the uniform Cauchy condition reduces exactly to the ordinary Cauchy condition for real sequences. The proof technique is the same: use completeness of to manufacture the limit, then verify the convergence rate is uniform (trivial when is a point, but requiring real work when is infinite, as in Step 2 of the proof above).
Why is the "let " step in the proof valid — couldn't that be circular?
It is not circular because it uses only a basic, independently established fact about limits in : if for all and as , then . This "closedness of under limits" fact is proved directly from the -definition of limit (by contradiction: if , take to get eventually, contradicting ), and it does not depend on the Cauchy criterion for uniform convergence or on any function-space machinery. So invoking it inside the proof introduces no circularity.
Is the sup-norm distance always a finite number?
Only when is a bounded function on ; in general could be if are unbounded and their difference is unbounded. This is precisely why the completeness corollary is stated for , the bounded functions, so that is guaranteed to be a genuine (finite-valued) metric. The main theorem itself sidesteps this issue by phrasing everything in terms of the condition " eventually," which makes sense (and is meaningful) regardless of whether the functions individually are bounded.
How does this criterion foreshadow the Weierstrass M-Test?
The M-Test gives a sufficient condition — for all , with — for a series to converge uniformly. The proof of the M-Test is literally an application of this article's theorem: one shows the partial sums are uniformly Cauchy by bounding the tail , which is small for large by the ordinary Cauchy criterion applied to the convergent numerical series , uniformly in . Example 1 above carries out exactly this argument in a concrete case.
What breaks if we only check the condition for (consecutive terms) instead of all ?
Checking only consecutive terms, i.e. , is strictly weaker than the uniform Cauchy condition and does not imply uniform convergence, exactly as with ordinary sequences of real numbers (where does not imply is Cauchy — consider , the harmonic partial sums, which diverge despite consecutive differences ). The full condition genuinely requires control over all pairs , not just adjacent indices.