Higher-Order Derivatives
Suppose a car's position at time is . Its velocity is . But what tells you whether the car is speeding up or slowing down? You need the derivative of the velocity itself — a "derivative of a derivative." This simple idea, iterating the operation of differentiation, is the subject of this article. It turns out to carry enormous structural weight in analysis. Higher-order derivatives let us classify functions by how much smoothness they possess. Some functions are differentiable only once. Others are differentiable any finite number of times. Some are differentiable infinitely often. This hierarchy is organized into the classes and . It is not a pedantic bookkeeping device. It is exactly the hypothesis needed to control the error in polynomial approximations (via Taylor's Theorem with Remainder). It also helps detect concavity and convexity of a graph. It lets us distinguish local maxima from minima beyond the first-derivative test. And it helps make sense of physical quantities like acceleration and jerk. The construction is inductive. Define as the derivative of wherever that derivative exists. Then define as the derivative of , and so on. Each step requires the previous derivative to exist on an open set (or at least a punctured neighborhood). This ensures differentiating it again makes sense. This recursive dependency is the source of every subtlety in the theory. A function can be differentiable without its derivative being differentiable. The resulting gaps in smoothness are exactly what the classes are designed to measure. This article gives the precise inductive definition of . It proves the basic algebraic facts (linearity, the product rule in its Leibniz form). It defines and studies the smoothness classes and . It also exhibits sharp counterexamples showing why each hypothesis in these definitions is load-bearing.
- The -th derivative is defined inductively: , and wherever the right side exists.
- Existence of requires to exist and be differentiable at , hence must exist on a neighborhood of .
- means exists on and is continuous there; means derivatives of all orders exist.
- The Leibniz rule generalizes the product rule: .
- Smoothness classes are strictly nested: , witnessed by explicit functions like .
- Key idea: differentiation is an operator you can iterate, and the n-th time you can iterate it and stay continuous measures a function's smoothness.
Where this lives today
Higher-order derivatives are the backbone of Taylor approximation: the coefficients of the Taylor polynomial of at a point are literally , and the size of the remainder term is controlled by a bound on — the entire subject of Taylor's Theorem with Remainder is a direct continuation of this article. In geometry and optimization, the sign of characterizes Convexity and the Second Derivative of a function, which underlies convex optimization algorithms throughout machine learning and operations research. In physics, , and beyond appear as acceleration, jerk, snap, and higher kinematic quantities used in robotics motion planning and aerospace trajectory design, where smoothness of a planned path (often demanded to be or higher) prevents mechanically damaging jerks in actuators. In numerical analysis, finite-difference schemes for solving differential equations require explicit error bounds built from higher derivatives (via Taylor expansions), and the stability of these schemes depends on which class the true solution belongs to. In differential geometry and PDE theory, the classes and (and their infinite-dimensional generalizations, Sobolev spaces) are the standard language for stating exactly how much regularity a solution to a differential equation is assumed or proved to have.
Ask the tutor: Why does at a point not guarantee that equals its Taylor series near that point?
Let be an open interval and let .
Inductive definition of . Define . Suppose and that has been defined on some open set . We say is times differentiable at a point if is differentiable at , i.e. if
exists (which in particular requires to be defined on an open interval around ). If this limit exists for every in an open set , we call the resulting function the -th derivative of . We write , , and for .
Smoothness classes. For , we say (f is of class on ) if exists at every point of and is continuous on . We say if for every ; such is called smooth. By convention is the set of continuous functions on , consistent with .
Intuition
Think of differentiation as a machine: feed it a function, it returns another function (the derivative), provided the limit defining that derivative exists everywhere you need it. Iterating the machine is exactly what , , etc. record. The subtlety is that the machine can jam: if itself is not differentiable at some point, the process simply stops there, and fails to exist at that point — even though and might both be perfectly well-behaved (continuous, even differentiable) nearby. A good mental picture is a tower of functions , each one built from the last by the same limiting operation, with the tower's height (how many rungs you can climb before the process breaks) measuring the smoothness of . The classes slice this tower at height and additionally demand that the top function you reach is continuous — not just that the limit exists pointwise, but that it exists and varies continuously. This extra continuity requirement is what makes well-behaved enough to support approximation theorems. Geometrically, measures the curvature or bending of the graph of : where the graph curves upward (convex), where it curves downward (concave), foreshadowing the link between Second Derivative Test and convexity. Physically, if is position, is velocity, is acceleration, and is "jerk" — the rate of change of acceleration, which is what makes a smooth elevator ride feel smooth rather than jarring.
Let be an open interval, let be an integer, and suppose are both times differentiable at every point of (equivalently, and exist on all of ).
(a) Linearity. For all , the function is times differentiable on , and
(b) Leibniz's rule. The product is times differentiable on , and
(c) Class closure. If , then and .
We use induction on , building on the Algebraic Rules of Differentiation (linearity and product rule for a single derivative), which we take as known base machinery.
Part (a): Linearity, by induction on . Base case . This is exactly the linearity rule for a single derivative: if are differentiable at , then is differentiable at with . This is a standard consequence of the linearity of limits applied to the difference quotient of . Inductive step. Suppose the claim holds for : whenever are times differentiable on , on . Now assume are times differentiable on ; in particular exist on and are themselves differentiable there (since exist). By the inductive hypothesis, equals as a function on . Since and are each differentiable on , the base case ( case of linearity, now applied to in place of ) gives that is differentiable on with derivative . Combining,
This completes the induction.
Part (b): Leibniz's rule, by induction on . Base case . This is the ordinary product rule: , which is exactly . This matches the standard product rule from Algebraic Rules of Differentiation. Inductive step. Suppose the formula holds for whenever both functions are times differentiable:
Now let be times differentiable on . Then each for and each for the corresponding index is differentiable on (since exist, all lower derivatives exist and are differentiable). Differentiate the right-hand side of the -formula term by term using linearity (Part (a), one-step case) and the ordinary product rule:
Hence
Split this into two sums, and . Re-index by (so runs from to ):
Renaming in and adding to :
The term appears only in the second sum (coefficient ), and the term appears only in the first sum (coefficient ). For , both sums contribute, and Pascal's identity gives
Therefore
which is exactly the claimed formula. This completes the induction, using Pascal's identity (a purely combinatorial fact, proved directly from the definition of binomial coefficients, hence not circular).
Part (c): Class closure. Suppose : so exist on and are continuous. By Part (a), exists on , and it is continuous since it is a linear combination of continuous functions (sum and scalar multiple of continuous functions are continuous, a basic fact about limits). Hence . For the product: by Part (b), . Since , in particular exists on for all (differentiability of order implies existence of all lower-order derivatives, immediate from the inductive definition — each for must exist and be differentiable for to exist at all). Moreover each for is differentiable, hence continuous (differentiability implies continuity, a standard one-variable fact), and is continuous by hypothesis. The same holds for . So each product is a product of continuous functions, hence continuous, and is a finite sum of continuous functions, hence continuous. Thus .
∎For every , , and this inclusion is strict: there exists .
We prove the inclusion here; the strictness is exhibited explicitly in the Worked Examples and the Counterexample section below.
Let , so exists on and is continuous. In particular exists on , so is differentiable on , and differentiability implies continuity (standard one-variable fact: if is differentiable at , then as , so is continuous at ). Hence is continuous on , which is exactly the statement .
∎Worked examples
Example 1: A function that is exactly but not , computed explicitly. Let be defined by
We compute the derivatives directly and locate exactly where smoothness fails. Computing . For , , so . For , , so . At , using the definition of the derivative,
since (squeeze). So for all (check: at this is ✓, at this is ✓, at it's ✓). Note is continuous everywhere (it is , a product/composition of continuous functions), so . Computing . For : . For : . At :
So for all (check at : ✓; at : ✓). This is continuous everywhere (again a product of continuous functions), so . Computing . For : . For : . At :
So does exist everywhere, and equals (check: gives ✓, gives ✓, and at gives ✓). This function is continuous, so in fact too! Computing . Now differentiate at :
The one-sided limits disagree (), so does not exist. Hence — in fact fails to exist at even a single point, so is not times differentiable on any open interval containing .
Conclusion: satisfies but (indeed does not exist at all). This shows the chain is strict at this level, generalizing the classic example (which is the analogue) to a higher order.
Example 2: Leibniz's rule applied to an asymmetric product, . Let and on ; we compute two ways to cross-check Leibniz's formula. Direct route. . We could expand and differentiate four times directly, but let's instead verify via Leibniz and then spot-check numerically at . Derivatives of . , so for all . Thus , , , , . Derivatives of . : , , , . At : , , , , . Applying Leibniz's rule with :
Compute each term:
- : .
- : .
- : .
- : .
- : .
Summing: . Cross-check by direct expansion. Write with . One can show by induction (or repeated product rule) that
matching the Leibniz coefficients for : namely paired with respectively (same computation, reorganized). At : , giving
matching exactly. This numerically confirms Leibniz's rule in a genuinely asymmetric case (different function types, non-palindromic coefficients all engaged).
The definition of requires to exist not just at but on a full neighborhood of , and then to be differentiable at . One might be tempted to weaken this to: " exists, and some difference quotient involving only values of near converges" — hoping to skip verifying that is genuinely differentiable. Here is why that shortcut is unsound, via a classical example due to the structure of oscillating functions. Define by
Step 1: is differentiable everywhere, but is discontinuous at . For , the product and chain rules give
At : (squeeze, since ). So exists, and is differentiable on all of — this is a genuine, everywhere-defined derivative . But as , does not converge, because oscillates between and without settling (e.g. along , , while along , ). So does not exist, hence is discontinuous at , even though itself is a perfectly well-defined real number.
Step 2: Consequently does not exist, because differentiability at of would force to be continuous at (differentiability implies continuity, as used in the Corollary's proof) — but we just showed is discontinuous at . So the inductive chain to define breaks down at the very first step: exists everywhere (so "iterating the operation" seems to make sense symbolically) but is not differentiable at , hence simply does not exist.
What this shows. If we dropped the requirement in the definition that be genuinely differentiable at (as opposed to merely defined near ), and instead tried some naive symbol-pushing — e.g., differentiating the formula "" term by term while ignorning that this formula is not valid at and that the resulting expression's limit at must be checked — we would get nonsensical or ill-defined results. The hypothesis " differentiable at " in the definition of is not a formality: dropping it (settling for "the formula for makes sense off a point") produces exactly this kind of failure, where , is differentiable everywhere (so we might loosely say ), but and does not exist at all. This is precisely why the classes (continuity of the derivative), not mere "-fold differentiability," are the robust objects used in analysis, e.g. as hypotheses for Taylor's Theorem with Remainder.
Scope, edge cases & common traps
| Situation | What holds | What can fail |
|---|---|---|
| exists at a single point | must exist on a neighborhood of and be differentiable at | need not exist at nearby points, and need not be continuous even at |
| exists and is continuous on for every | may fail to exist anywhere | |
| (Theorem, parts a,c) | only where ; must exclude zeros of | |
| All derivatives exist and are continuous | Does not imply is analytic (equal to its Taylor series) — see FAQ | |
| Composition | If , then (provable by induction using the chain rule, stated here without full proof) | The formula for (Faà di Bruno's formula) is far more complex than Leibniz's rule and is easy to misstate |
The mathematician behind it
Origins · 1 minGottfried Wilhelm Leibniz and how this was discovered
Leibniz developed the differential calculus independently of Newton in the 1670s–80s, and it is his notation — , , and the systematic use of for higher derivatives — that survives in nearly all of modern analysis. His 1695 correspondence with Johann Bernoulli contains the first explicit statement of what we now call Leibniz's rule for the -th derivative of a product, discovered while investigating fractional (non-integer order) derivatives, an idea decades ahead of its formal development. Leibniz's insistence on symbolic manipulation and rigorous notation, rather than purely geometric argument, is precisely what makes the inductive machinery of tractable and teachable today.
What is the difference between " is times differentiable" and ""?
" is times differentiable at a point (or on a set)" only asserts that the limit defining exists there — nothing is said about whether varies continuously. "" additionally requires to be continuous on . These are genuinely different: the counterexample (extended by ) is differentiable everywhere (so "1 time differentiable" everywhere), yet is discontinuous at , so . Every function is times differentiable, but not conversely. This distinction matters because theorems like Taylor's theorem with the Lagrange remainder typically require the stronger (or ) hypothesis, not merely "n times differentiable," to control error terms rigorously.
Does mean equals its own Taylor series?
No — this is one of the most important subtleties in analysis. A function all of whose derivatives exist and are continuous (smooth) need not be analytic (equal to the sum of its Taylor series in a neighborhood of each point). The standard counterexample is for , : one can show by induction that every derivative , yet is not identically zero near . So its Taylor series at is the zero function, which does not equal anywhere except at itself. Thus is a strictly larger class than the analytic functions ; this gap is exactly what Taylor's Theorem with Remainder is designed to quantify and control.
Why does the definition require to exist on a whole neighborhood, not just at the point ?
Differentiability at a point is inherently a two-sided limiting statement: must be defined for for all sufficiently small (both positive and negative, unless working on a one-sided endpoint) in order for the difference quotient to even make sense as . If were defined only at itself, the difference quotient could not be formed for , and no derivative could ever be extracted. This is not a technicality specific to higher derivatives — it is inherited directly from the ordinary definition of a single derivative, which already requires the function to be defined near the point in question.
Is every function's -th derivative automatically differentiable?
No, and this is exactly the gap between and . Being in only guarantees is continuous, not differentiable. The function (generalizing Worked Example 1's , which is the case) is a clean example: it lies in but its -th derivative fails to be differentiable at , so . This is precisely how one proves the class inclusions are strict for every , not just an isolated low-order phenomenon.
How does Leibniz's rule relate to the binomial theorem?
The formula has exactly the same combinatorial structure as the binomial theorem , and the proofs are structurally parallel: both proceed by induction using Pascal's identity to merge two sums into one with binomial coefficients. Formally, one can think of the differentiation operator as behaving like "," which is the same recursive structure that generates binomial coefficients when iterated times — this is why the same numbers appear in both settings.
Do higher-order derivatives make sense for functions of several variables?
Yes, but the theory becomes richer: for , one first defines partial derivatives , then second-order partials , and the analogue of smoothness additionally requires all mixed partials up to order to exist and be continuous. A celebrated theorem (Clairaut's/Schwarz's theorem) states that under continuity hypotheses, mixed partials commute: . This multivariable extension is essential for defining the Hessian matrix, which generalizes the single-variable second derivative test used to classify critical points.
Why does the problem statement distinguish from merely writing "exists everywhere"?
Because "exists everywhere" is a strictly weaker, less useful hypothesis for proving theorems. Many key results in analysis — including error bounds in Taylor's theorem, and criteria for convexity — require not just that exists pointwise but that it does not jump around unpredictably, which is exactly what continuity guarantees. Working with instead of the weaker pointwise-existence notion lets you invoke the Extreme Value Theorem and Intermediate Value Theorem on itself (since those theorems require continuity), which is essential machinery for bounding remainder terms and locating critical points of higher order.