Uniform Convergence and Differentiation
Suppose a sequence of differentiable functions converges pointwise to a limit . Can we conclude that ? That would mean . This is one of the most seductive false moves in analysis. It fails even for beautifully behaved, uniformly convergent sequences. The failure matters because differentiation under a limit sign is used constantly. It appears in solving differential equations by successive approximation. It also justifies term-by-term differentiation of power series and Fourier series. It even helps in constructing exotic objects like continuous nowhere-differentiable functions. The surprising fact is this: uniform convergence of itself is neither necessary nor sufficient to control the derivatives. What actually matters is uniform convergence of the derivatives . This must be paired with convergence of the sequence at just a single point. This is a striking asymmetry compared to the theorem for integration. There, uniform convergence of suffices to pass the limit inside the integral. Differentiation is an unbounded, "rougher" operation than integration. It punishes any attempt at a naive analogous theorem. The resolution rests on the Mean Value Theorem. It converts control of into control of the increments of . This yields a Cauchy criterion for uniform convergence. This is the same kind of quantitative bridge used when working with Uniform Convergence and Integration. Here, though, the roles of the function and its derivative are reversed relative to naive intuition. This article states and proves the precise theorem. It works two nontrivial examples. It exhibits a sharp counterexample showing why uniform convergence of cannot be dropped. It also situates the result within the broader architecture of analysis. This points toward the Arzelà–Ascoli Theorem and the theory of Convergence of Fourier Series.
- Pointwise (even uniform) convergence of does not imply , or even that exists.
- The correct hypothesis is: converges uniformly to some , and converges for one point .
- Under these hypotheses uniformly, is differentiable, and .
- The proof converts derivative differences into function differences via the Mean Value Theorem, then uses the Cauchy criterion for uniform convergence.
- A classic counterexample ( type constructions) shows uniform convergence of alone is useless for differentiation.
- The theorem underlies term-by-term differentiation of power series and previews deeper compactness results like Arzelà–Ascoli Theorem.
- Key idea: control the derivatives uniformly first — the functions and their limit differentiability follow as a consequence, not the other way around.
Where this lives today
Term-by-term differentiation under the correct hypotheses is the rigorous backbone of solving ordinary and partial differential equations by series methods, including power series solutions and Frobenius-type expansions, where one must justify that a formally differentiated series really does represent the derivative of the sum. In Fourier analysis, this theorem (or its refinements) governs when a Fourier series can be differentiated term by term to recover the derivative of the represented function — a delicate question central to the study of Convergence of Fourier Series, since Fourier coefficients typically decay only like or , right at the edge of what uniform convergence of the derivative series demands. In numerical analysis and physics, the same logic justifies differentiating asymptotic expansions and perturbation series term by term, provided the derivative series can be shown to converge uniformly (often via comparison tests analogous to the Weierstrass -test used above). In functional analysis, the phenomenon that uniform convergence of functions does not control derivatives motivates the study of stronger topologies (e.g. -norm convergence) and compactness criteria such as the Arzelà–Ascoli Theorem, which characterizes when a family of functions has uniformly convergent subsequences with controlled derivatives. In probability and statistics, uniform convergence of derivative sequences underlies rigorous justifications for differentiating moment generating functions or characteristic functions term by term to obtain moments.
:::quiz[If uniformly on and each is differentiable, which additional hypothesis guarantees ?]
- Nothing further is needed; uniform convergence of alone suffices
- converges uniformly on , and converges at some point ✓
- converges pointwise on
- Each is a polynomial
:::quiz[In the counterexample on , which statement is correct?]
- pointwise but not uniformly
- uniformly while diverges
- uniformly, but diverges to infinity ✓
- Both and converge uniformly to
:::faq[Does the theorem require the interval to be bounded?] Yes, the standard statement requires a closed bounded interval, because the proof multiplies the uniform derivative bound by the factor , which must be finite for the argument to close. On an unbounded domain like , one typically applies the theorem separately on each bounded subinterval and observes that differentiability is a local property, so the conclusions patch together consistently across all reals, provided the hypotheses hold on every bounded subinterval.
Ask the tutor: Can you show me a sequence where converges pointwise but not uniformly, and the limit's derivative genuinely disagrees with ?
Let and let be a sequence of functions. We say uniformly on if for every there exists such that for all and all ,
Equivalently, as . This is to be contrasted with pointwise convergence, where for each fixed the sequence , but the rate of convergence may depend on and need not be uniform across . A sequence satisfies the uniform Cauchy criterion on if for every there is such that for all and all , . On (a complete metric space), the uniform Cauchy criterion is equivalent to uniform convergence to some limit function.
Intuition
Differentiation is a local slope operation, so it is exquisitely sensitive to small, fast oscillations that uniform convergence of the function values does nothing to suppress. A sequence of functions can be squeezed uniformly close to a limit — within a band of height — while still wiggling with unbounded steepness inside that band. The graphs converge, but the slopes of the graphs do not. Uniform convergence of the derivatives is a fundamentally stronger condition: it forces the tangent lines of to converge uniformly to the tangent lines of a limiting slope field . Once the slope field is under uniform control, and we anchor the family at a single point where we know converges, the Mean Value Theorem lets us "integrate" that uniform control on slopes back into uniform control on the function values themselves — like reconstructing a road's elevation profile from a GPS-accurate uniformly convergent record of its grade, plus one known altitude checkpoint.
Why the derivative bound matters more than the function bound
The picture shows the mechanism of every counterexample in this territory: squeeze the amplitude to zero while raising the frequency, and uniform convergence of function values is trivially preserved while the derivative diverges everywhere. This motivates why the theorem below places its central hypothesis on , not on .
Let be a closed bounded interval and let be a sequence of functions, each differentiable on (one-sided derivatives at the endpoints). Suppose: 1. There exists a point such that the numerical sequence converges. 2. The sequence of derivatives converges uniformly on to some function . Then: (a) The sequence converges uniformly on to a function . (b) is differentiable on , and
That is,
We proceed in three stages: first establish the uniform Cauchy criterion for using the Mean Value Theorem applied to differences ; then pass to the uniform limit ; then verify differentiability of and identify by a careful -argument that again invokes the Mean Value Theorem, this time on a fixed pair of functions.
Step 1: is uniformly Cauchy on . Fix . Since converges, it is Cauchy, so there exists such that
Since converges uniformly on , it is uniformly Cauchy: there exists such that
(If the theorem is a triviality about a single point, so assume .) Let and fix . Apply the Mean Value Theorem to the differentiable function on the interval with endpoints and (for any , ): there exists a point strictly between and with
Hence
(When this inequality holds trivially as .) By the triangle inequality,
This bound holds for every and does not depend on , so
Thus satisfies the uniform Cauchy criterion on .
Step 2: Existence of the uniform limit . For each fixed , the numerical sequence is Cauchy (a special case of Step 1 with the single point ), hence converges in by completeness. Define
We claim uniformly. Given , take as in Step 1 so that for all and all . Fix and , and let in this inequality; since and absolute value is continuous, we get
As was arbitrary (with depending only on , not ), this proves uniformly on , establishing (a).
Step 3: Differentiability of and identification of . Fix a point ; we show exists and equals . Define, for and with , the difference quotients
Since is differentiable at , exists for each . Claim: uniformly on . For and , apply the Mean Value Theorem to on the interval with endpoints and : there is between and with
Given , uniform convergence of gives such that implies for every , in particular for this . Hence
so is uniformly Cauchy on , hence converges uniformly there to some limit function. Since pointwise for each fixed (because and ), the uniform limit of must equal . This proves the claim. Now we identify the limit of as . We know:
- as , for each fixed ;
- uniformly on ;
- as (given, since pointwise, being a consequence of uniform convergence).
This is precisely the hypothesis of the standard theorem on interchange of iterated limits for a doubly-indexed family (uniform convergence in one index plus convergence of the limits in the other index forces equality of the iterated limits): we conclude
We justify this interchange directly to keep the proof self-contained. Fix . By uniform convergence , choose so that
Fix such an also large enough (possible since ) that
Since as , there is such that
For such , combine the three estimates by the triangle inequality:
Thus , i.e.
Since was arbitrary, is differentiable on all of and everywhere, completing part (b).
∎Worked examples
Example 1 — a convergent series of functions, differentiated term by term. Let
We show that is differentiable with derivative , on any interval , e.g. . Setup. Each is a finite sum of differentiable functions, hence differentiable everywhere, with
Convergence at a point. Take : then for every , so trivially . Uniform convergence of derivatives. For any and any ,
using . The bound on the right is independent of and is the tail of the convergent series (a -series with ), so it as uniformly in . Hence is uniformly Cauchy on all of , and by completeness converges uniformly to some function
Apply the theorem. On (or any bounded interval, or indeed all of by applying the theorem on each ), the hypotheses hold: convergence at , and uniform convergence of derivatives. The theorem gives: uniformly, is differentiable, and
Notice this argument used the Weierstrass M-test (, ) only on the derivative series — exactly the point of the theorem. We never needed to prove uniform convergence of itself directly; it fell out of the argument for free.
Example 2 — a case where the hypothesis must be checked carefully, with a genuinely asymmetric sequence. Let
This is a standard example, but examined here on the asymmetric interval (not centered anywhere near ), which forces us to actually use the endpoint behavior rather than symmetry. Step A: compute . By the quotient rule,
Step B: pointwise limits. For fixed , as ,
(the second limit: numerator is , denominator is , so the ratio is ). So pointwise and on , consistent with — but we must check the convergence of is genuinely uniform on before invoking the theorem, since that is its essential hypothesis. Step C: uniform bound on for . We estimate
For and , we have , so for , eventually (for and , ), giving . Hence
using on . This bound is independent of and , so
confirming uniformly on . Step D: apply the theorem. Take : , convergent. Both hypotheses hold on , so the theorem gives uniformly on (here , consistent with the direct pointwise computation, and one can also check directly that ), is differentiable, and
This matches direct computation, but the value of the theorem is that it guarantees this identification without needing an independent proof that is differentiable with derivative — the argument is completely mechanical once the two hypotheses are checked.
Define, for ,
Uniform convergence of . For every ,
and this bound is independent of . Hence uniformly on . The function is certainly differentiable, with . But the derivatives fail to converge, let alone uniformly. We have
At : . So diverges — it does not even converge pointwise at this point, let alone uniformly on . Diagnosis. This example satisfies "uniform convergence of " (the hypothesis one might naively guess suffices for differentiating term by term) but violates the theorem's actual hypothesis — uniform convergence of — and the conclusion catastrophically fails: does not exist, so there is no candidate limit function to equal . This shows that in the theorem, the hypothesis " converges uniformly" cannot be weakened to " converges uniformly": the two conditions are logically independent, and it is squarely the derivative sequence that must be tamed. The mechanism is exactly the one shown in the intuition figure: amplitude crushes the function uniformly to , while frequency sends the slope to infinity.
Scope, edge cases & common traps
| Situation | What holds | What can fail |
|---|---|---|
| uniformly only (no control on ) | may not even be continuous... no wait, uniform limits of continuous functions are continuous, but need not be differentiable even if all are | ; differentiable at all |
| converges uniformly, converges at one point | uniformly, differentiable, | Nothing — this is exactly the theorem's hypothesis set |
| converges only pointwise (not uniformly) | Conclusion can fail badly | Term-by-term differentiation unjustified |
| Interval unbounded (e.g. all of ) | Theorem applies on each bounded ; conclusions patch together since derivative is a local notion | Uniformity constant may depend on the interval chosen |
| merely continuous, not differentiable | Theorem inapplicable; hypotheses require differentiability of each | No differentiation to discuss |
The mathematician behind it
Origins · 1 minKarl Weierstrass and how this was discovered
Weierstrass is the figure most responsible for the modern, fully rigorous - treatment of limits, continuity, and uniform convergence that makes a theorem like this one precise and provable rather than merely plausible. Working largely in isolation as a secondary-school teacher before his mathematical talent was recognized, he later became the central architect of rigorous analysis at the University of Berlin, training a generation of mathematicians in the careful distinction between pointwise and uniform notions of convergence — a distinction that this very theorem depends on at every step.
Why doesn't uniform convergence of imply uniform convergence of ?
Differentiation amplifies high-frequency, low-amplitude oscillations rather than suppressing them. A sequence like can be squeezed uniformly to zero in amplitude while its frequency grows, and differentiating multiplies by that growing frequency, producing derivatives whose size explodes. Uniform convergence only bounds the vertical closeness of graphs; it places no constraint whatsoever on the steepness of the oscillations occurring within that narrow vertical band. This is why the correct hypothesis for justifying term-by-term differentiation must directly control the derivative sequence, not merely the original functions.
Why is convergence at a single point enough, instead of needing convergence everywhere?
The Mean Value Theorem supplies the missing information. For any , the difference can be written as plus a correction term for some between and . If the derivatives are uniformly close (small independent of ) and the interval is bounded, that correction term is uniformly small; combined with smallness of , this pins down uniformly in . So one anchor point, plus uniform control of the derivative, propagates control across the whole bounded interval.
Is this the same as the theorem for integrating uniformly convergent sequences?
No, and the asymmetry is the entire point of this article. For integration, uniform convergence of itself is the natural and sufficient hypothesis, because integration is a smoothing, bounded linear operation on continuous functions over a compact interval, as covered under Uniform Convergence and Integration. Differentiation is the reverse, unbounded operation, so the analogous naive hypothesis (uniform convergence of ) is not merely insufficient but can fail completely, as the sine counterexample demonstrates. The correct hypothesis shifts to the derivative sequence instead.
What happens if we only assume converges pointwise, not uniformly?
The conclusion can fail. There exist sequences of differentiable functions with pointwise or even uniformly, and converging pointwise to some , where fails to be differentiable at some point, or is differentiable but . Uniform convergence of the derivatives is doing genuine work in the proof: it is precisely what allows the Mean Value Theorem estimate to be made independent of the point , which pointwise convergence alone cannot guarantee.
How does this theorem relate to term-by-term differentiation of power series?
For a power series with radius of convergence , the term-by-term differentiated series has the same radius of convergence, and converges uniformly on any closed subinterval strictly inside . Applying this theorem with the partial sums confirms that the power series can be differentiated term by term inside its interval of convergence, which is the standard justification used throughout calculus for manipulating Taylor series.
Does the theorem generalize beyond real-valued functions on an interval?
Yes, in spirit: analogous statements hold for sequences of differentiable functions between Banach spaces, and for functions on more general domains, provided one has an analogue of the Mean Value Theorem (such as the Mean Value Inequality for Banach-space-valued functions). The core mechanism — trading uniform control on the derivative plus one anchor value for uniform control on the function — survives in these more abstract settings and reappears in the compactness theory behind the Arzelà–Ascoli Theorem.