Jacobian Matrix and Linear Approximation
Suppose you have a machine that takes in three numbers. Say, the price, advertising budget, and interest rate. It outputs two numbers, sales and profit. How does a small nudge to the inputs move the outputs? For a single-variable function, the derivative answers this question. It is a number telling you the local stretching factor. For a map between spaces of different dimensions, a single number no longer suffices. Different input directions can push the output in different directions by different amounts. The right replacement is a matrix — the Jacobian matrix. The right question is not "what is the slope." It is "what is the best linear map approximating this function near a point." This article develops the derivative of a vector-valued function of several variables. It treats this derivative as exactly that best linear approximation. It shows that when such an approximation exists, its matrix is forced to be the matrix of partial derivatives — the Jacobian. This unifies single-variable differentiation, gradients of scalar fields, and the derivative of parametrized curves. All become special cases of one object. It matters because almost every serious tool in multivariable calculus relies on this matrix. This includes the chain rule, the inverse and implicit function theorems, change of variables in integrals, and optimization with constraints. All are stated and proved in terms of this matrix. The central subtlety, already visible in one variable, is this: "having partial derivatives" is not the same as "being differentiable." A function can have all its partial derivatives at a point. Yet it can still fail to be well-approximated by any linear map there. The correct logical order is as follows. Differentiability is a geometric condition about linear approximation. When it holds, the partial derivatives assemble into the unique matrix representing it. Getting this order right is essential. It separates a working command of the material from a collection of formulas. By the end of this article you will have several things. You will have a precise definition of differentiability for maps . You will have a full proof that differentiability forces the Jacobian matrix to be the derivative. You will have a proof that continuous partial derivatives are sufficient for differentiability. You will see worked computations with genuinely asymmetric (non-square, non-symmetric) examples. Finally, you will see an explicit counterexample. It shows why the continuity hypothesis on partial derivatives cannot be dropped.
- The derivative of at a point, when it exists, is a linear map best approximating near that point.
- That linear map, in standard coordinates, is represented by the Jacobian matrix , an array.
- Differentiability is strictly stronger than "all partial derivatives exist"; existence of partials alone does not guarantee a good linear approximation.
- If all partial derivatives exist and are continuous near , then is differentiable at (the sufficient condition).
- The Jacobian matrix reduces to familiar objects: the ordinary derivative (n=m=1), the gradient (m=1), and the velocity vector (n=1).
- Key idea: differentiability means the nonlinear map agrees with an honest linear map to first order, and that linear map's matrix is exactly the array of partial derivatives.
Where this lives today
The Jacobian matrix is the working tool behind the inverse function theorem and implicit function theorem, both of which test invertibility of a nonlinear map locally by checking invertibility of its Jacobian — this is the direction The Inverse Function Theorem develops next. In multivariable calculus, the Jacobian determinant is exactly the correction factor in the change-of-variables formula for multiple integrals (as seen already in the polar-coordinates example, where ). In differential geometry, the Jacobian of a coordinate change is what makes tensors and differential forms transform consistently between charts. In numerical analysis and optimization, Newton's method in several variables iterates , using the Jacobian at each step to build a local linear model of a nonlinear system. In machine learning, the backpropagation algorithm for training neural networks is precisely the The Chain Rule in Several Variables applied repeatedly to compose Jacobians of each network layer, so that the gradient of a scalar loss with respect to millions of parameters is computed as a product of Jacobian matrices. In physics and engineering, Jacobians appear in the transformation of coordinate systems (Lagrangian to Eulerian descriptions in fluid mechanics, generalized coordinates in classical mechanics), and in robotics the Jacobian relating joint angles to end-effector position and velocity is a direct application of this same linear-approximation idea to the Differentiability and the Total Derivative framework in a physically concrete setting.
Ask the tutor: Can you show me why the Jacobian determinant appears as the scaling factor in the change-of-variables formula for double integrals?
Let be open, let , and let . We say is differentiable at if there exists a linear map such that
where the limit is taken over with , and denotes the Euclidean norm (on in the denominator, on in the numerator). If such an exists it is unique (proved below), and is called the total derivative of at , written . Writing in coordinates, the Jacobian matrix of at is the matrix of partial derivatives
provided all these partial derivatives exist at . The theorem below shows that if is differentiable at , then all partials exist and is represented, in the standard bases, exactly by : for every ,
Intuition
Think of as a deformation of space: it takes the point and its neighbors and relocates them. Differentiability says that if you zoom in close enough to , the deformation looks like a fixed linear transformation, up to an error that vanishes faster than the distance you've moved. The Jacobian matrix is the "zoomed-in" picture of at : it tells you, to first order, how a small displacement in the input space gets stretched, rotated, sheared, and reshaped into a displacement in the output space. Each column of the Jacobian records what happens when you move purely in one coordinate direction: the -th column is , the velocity vector traced out in output space as you sweep the -th input coordinate through . Each row is the gradient of one output component , telling you how that single output reacts to a general infinitesimal input displacement. The matrix stitches together "input probes" and "output responses" into one linear snapshot. The graph below visualizes the case : a curve in the plane. The Jacobian is a single column vector — the tangent (velocity) vector — and the affine approximation is the tangent line to the curve at the chosen point.
Now consider , : a scalar height function over the plane. Here the Jacobian is a row matrix — the gradient — and the best affine approximation is the tangent plane to the graph.
The derivative as a linear map: theorem and proof
Let be open, , and . Suppose is differentiable at with derivative . Then: 1. is the unique linear map satisfying the defining limit condition. 2. Every partial derivative , for , , exists. 3. The matrix of with respect to the standard bases of and is exactly the Jacobian matrix ; that is, for all . 4. is continuous at .
Technique: direct estimation with the definition, exploiting linearity and directional limits along coordinate axes (a standard –argument, non-circular: it uses only the definition of differentiability and single-variable limit facts). Step 1 (Uniqueness of ). Suppose both satisfy the defining condition. Let , a linear map . For any fixed and any small enough that , apply the triangle inequality to
Since is linear, , so
Write (for ), so each term on the right has the form . As , , and by hypothesis each fraction . Hence , forcing . Since was arbitrary and automatically by linearity, , i.e. . This proves uniqueness. Step 2 (Existence of partial derivatives and identification of 's matrix). Fix and let be the -th standard basis vector. For small enough that , apply the differentiability condition with :
Since and by linearity, this says
i.e.
as a limit of vectors in . A vector-valued limit exists and equals a given vector if and only if each coordinate converges to the corresponding coordinate (this is immediate from the definition of the Euclidean norm and the two-sided squeeze ). Therefore, for each , the single-variable limit
exists and equals the -th coordinate of . Thus every partial derivative exists, and the -th column of the matrix of (in standard bases) is precisely
Since a linear map's matrix is formed by placing as the -th column, the matrix of is exactly , and for all by linearity (write and use ). Step 3 (Continuity at ). Since is differentiable at with derivative , for near ,
Every linear map is continuous (its matrix entries are finite, so by Cauchy–Schwarz as , where is the operator norm, itself finite since is finite-dimensional). Also : indeed for , as (product of a factor going to and a bounded-then-vanishing factor), and . Hence as , which is precisely continuity of at .
∎The theorem above tells us the matrix of the derivative, when the derivative exists, must be the Jacobian — but it does not, by itself, guarantee differentiability from partial derivatives alone. That converse direction requires an extra hypothesis, continuity of the partials, proved next.
Let be open, , and . Suppose there is an open ball on which all partial derivatives exist, and each is continuous at . Then is differentiable at , and is represented by the Jacobian matrix .
Technique: reduce to one output coordinate at a time, then use the single-variable Mean Value Theorem coordinate-by-coordinate on the input, telescoping the increment through the standard basis vectors. It suffices to treat each component separately (differentiability of with the claimed matrix is equivalent to differentiability of each with the corresponding row, by the coordinate characterization of vector limits used in Step 2 above). So fix and write ; we show
where . For with , define the telescoping chain of points
so and ; all lie in since each partial sum of coordinates changed has length at most (as is convex and each lies on the segment-like path within the ball — more precisely, because has the first coordinates of and zeros elsewhere, so its norm is at most ). Telescope:
The -th term differs from to only in the -th coordinate, by amount . Define the single-variable function
This is well-defined and differentiable on the relevant interval since exists throughout , and . By the Mean Value Theorem (applicable since is differentiable, hence continuous, on the closed interval and differentiable on the open interval), there exists strictly between and (or if , in which case the term below is simply zero) such that
Let ; note by the same coordinatewise bound as above, so whenever . Summing,
Now subtract the candidate linear term:
By the Cauchy–Schwarz inequality (or simply ),
Divide both sides by (valid for ):
As , each (shown above), and by hypothesis each is continuous at , so each term on the right tends to . Hence the left side tends to , which is exactly the statement that is differentiable at with derivative (as a linear functional) , i.e. matrix row . Applying this to each and stacking the rows gives differentiability of with derivative matrix .
∎If is differentiable at with derivative matrix and is differentiable at with derivative matrix , then (as will be proved in full under The Chain Rule in Several Variables) is differentiable at with
an ordinary matrix product. This corollary is stated here only to preview the payoff; its proof needs the composition estimate developed under that heading.
Worked examples
Example 1 — a genuinely rectangular, asymmetric map. Let be
and compute the Jacobian and the best affine approximation at . Compute partials of :
At : , , . Compute partials of :
At : , , . All six partials are polynomials, exponentials, sines and cosines composed smoothly — each is continuous everywhere on . By the sufficient condition, is differentiable at , with Jacobian
Also . The best affine (linear + constant) approximation near is
Concretely, the first output component is approximated by , and the second by . Sanity check via a specific displacement. Take (small, asymmetric in all three coordinates). The linear prediction for the change in is
Numerically , so the predicted change is approximately . Direct evaluation: .
Here ; squaring gives , times 3 is ; and . So — but it's cleaner to compute the change: . Since , . Then , giving a change of . This matches the linear prediction to within — the tiny discrepancy is exactly the higher-order error term the definition guarantees vanishes faster than .
Example 2 — polar coordinates, a classical square Jacobian used constantly in change of variables. Let , . Compute at the asymmetric point .
So in general
At : , , so
The determinant is , and indeed the general formula gives at this point, matching. This determinant is precisely the factor appearing in — the Jacobian determinant governing area distortion under polar coordinates, a fact that becomes central once one studies change of variables in multiple integrals. This is a case where all partials are continuous everywhere (compositions of polynomials with sine and cosine), so is differentiable everywhere by the theorem, and the affine approximation at , whose Cartesian image is , is
The theorem requires continuity of the partial derivatives near the point, not merely their existence. Dropping continuity breaks the conclusion. Define by
Partial derivatives exist everywhere. Away from the origin, is a composition of smooth functions (since there), so and certainly exist there by the ordinary rules of differentiation. At the origin, compute directly from the definition:
since (squeeze theorem). By symmetry as well. So both partial derivatives exist at every point of , including the origin. But the partials are discontinuous at the origin. For , let . By the product and chain rules,
Approach the origin along the ray , for large integers , so and . Then and , and (since ). So
for every , while . Since points as but along this sequence is constantly , the partial derivative is discontinuous at the origin. (The same computation with by symmetry shows it is discontinuous there too.) Consequence: differentiability at the origin genuinely fails to follow "for free," and in fact fails here. We test the definition directly. If were differentiable at , since both partials there are , the only candidate linear map is , so we would need
as . This limit does in fact hold, by the squeeze theorem (), so in this particular example is differentiable at the origin with despite the discontinuity of the partials — illustrating that the condition is sufficient but never claimed necessary. To see a case where discontinuous partials do destroy differentiability, modify the example: let
the classical example. One can show (by the same style of computation) , both partials exist everywhere and are discontinuous at the origin, and moreover approaching along shows itself fails the differentiability limit at the origin: taking , , which is consistent with but the mixed partials and disagree at the origin (a related pathology), signaling the same underlying discontinuity phenomenon. The moral in both cases stands: existence of partial derivatives, even everywhere, is logically weaker than differentiability; continuity of the partials is what bridges the gap, and the hypothesis cannot simply be replaced by "partials exist."
Scope, edge cases & common traps
| Situation | What is true | Common error |
|---|---|---|
| differentiable at | All partials exist at ; 's matrix is | Assuming the converse always holds |
| Partials exist near , continuous at | differentiable at (this article's theorem) | Requiring continuity only at , not on a neighborhood (the proof needs the MVT on a whole segment) |
| Partials exist near , but discontinuous at | Differentiability at is undetermined — can hold or fail | Concluding non-differentiability from discontinuity of partials alone |
| continuous at | No conclusion about differentiability | Confusing continuity with differentiability (as in one variable) |
| Jacobian is rectangular; no determinant, no invertibility question | Trying to compute "the Jacobian determinant" for non-square maps |
The mathematician behind it
Origins · 1 minCarl Gustav Jacob Jacobi and how this was discovered
Jacobi was one of the most prolific mathematicians of the nineteenth century, working across elliptic functions, number theory, mechanics, and what would later be called linear and multilinear algebra. He was among the first to systematically study determinants formed from partial derivatives — functional determinants — in connection with problems of implicit functions, coordinate changes, and dependence of functions. The matrix and its determinant that bear his name arose from exactly the questions this article addresses: when can several functions of several variables be locally inverted, and how does a change of variables distort volume. Jacobi's methodical treatment of these functional determinants, published in the 1830s and 1840s, gave later analysts (Riemann, Weierstrass, and the twentieth-century founders of rigorous multivariable analysis) the tool they needed to make "linear approximation in several variables" a precise, checkable notion rather than a heuristic.
Why isn't the Jacobian just "the derivative" in the same sense as for single-variable functions?
It is the same idea, generalized correctly. In one variable, is the number such that , i.e. multiplication by is the best linear approximation to the increment of . When the domain or codomain has dimension greater than one, "multiplication by a number" is replaced by "application of a linear map," because a single number cannot describe how different directions get stretched differently. The Jacobian matrix is simply the coordinate representation of that linear map, so in the case it is literally the matrix , recovering the classical derivative exactly.
Does the Jacobian matrix depend on the choice of coordinates?
The entries of the Jacobian matrix, as literally written with partial derivatives with respect to particular coordinate functions, do depend on the coordinate system used on both domain and codomain. However, the underlying object — the linear map — is coordinate-independent; changing coordinates just changes the basis in which you write that linear map's matrix, exactly as with any linear transformation. This is why, in more advanced treatments, one is careful to distinguish "the derivative" (a linear map) from "the Jacobian matrix" (its representation in the standard, or some chosen, bases).
If a function is differentiable at a point, must its partial derivatives be continuous there?
No. Differentiability at a single point is a purely local, pointwise condition about the existence of a good linear approximation there; it says nothing about the behavior of the partial derivatives at nearby points. It is entirely possible (and the counterexample in this article nearly exhibits, with a closely related classical example achieving it exactly) for to be differentiable at while its partial derivative functions are discontinuous at . The condition (continuous partials near ) is only a sufficient, not necessary, condition for differentiability at .
How is the Jacobian matrix related to the gradient?
The gradient is the special case : when is scalar-valued, the Jacobian matrix is a single row, , and this row, viewed as a vector rather than a matrix, is exactly the gradient . The derivative acting on a displacement is then the dot product , which is the classical directional-derivative formula (when is a unit vector) generalized to arbitrary .
Why does the proof of the theorem move one coordinate at a time instead of all at once?
Because the Mean Value Theorem is fundamentally a single-variable tool: it requires a function of one real variable, differentiable on an interval. By freezing all but one coordinate and moving along a straight segment parallel to a single axis, the proof reduces the multivariable increment to a sum of genuinely one-variable increments, each amenable to the ordinary Mean Value Theorem. Telescoping these one-variable estimates and then using continuity of each partial derivative at the base point is exactly what controls the total error and produces the vanishing-remainder estimate that differentiability requires.
Is the Jacobian matrix always square?
No, and this is a frequent point of confusion. The Jacobian matrix of is , matching the codomain and domain dimensions respectively; it is square only when . Only in the square case does it make sense to speak of the Jacobian determinant, which measures how locally scales -dimensional volume, and only in the square case can the Jacobian matrix be tested for invertibility, which is the hypothesis driving the inverse function theorem.
What goes wrong if I try to define the Jacobian using only one-sided or directional derivatives instead of the full differentiability limit?
Directional derivatives (including partials, which are directional derivatives along axes) only test behavior along straight lines through , one direction at a time, and can all exist and even combine "linearly" without controlling behavior along curved paths approaching . The differentiability definition demands the approximation error vanish uniformly over all directions simultaneously, relative to , as in any manner whatsoever. This stronger, direction-independent requirement is exactly what the counterexample-style constructions exploit: functions can behave nicely along every straight ray yet fail the full limit due to curved approach paths.