Linearization and the Jacobian
Near an equilibrium, how does a nonlinear system actually behave? This question sits at the heart of nearly all applied dynamics. Almost no system encountered in physics, biology, or engineering is exactly linear. The strategy of linearization answers it by replacing the full nonlinear vector field with its best linear approximation at a fixed point. This turns an intractable nonlinear problem into a linear algebra problem we already know how to solve. This matters because the eigenvalues of a single matrix — the Jacobian — often determine, with mathematical certainty, whether trajectories starting nearby will spiral away, decay back, or do something the linear picture cannot capture at all. The big picture is a bridge between two worlds: the qualitative theory of Fixed Points and Equilibria within Autonomous Systems and Phase Space, and the fully computable world of constant-coefficient linear systems. Linearization builds that bridge explicitly, via a first-order Taylor expansion of the vector field. The Jacobian matrix is the coefficient matrix of the resulting linear system. This article develops the construction with full rigor. It defines the Jacobian, and proves that the linearized flow is the correct first-order approximation to the nonlinear flow. It also states precisely the theorem — due in spirit to Lyapunov and Perron — that governs when this approximation is qualitatively trustworthy, not merely numerically close. We will be careful about the difference between two claims that are often blurred in a first course. First: the linear vector field approximates the nonlinear one to first order near the fixed point (an easy calculus fact). Second: the phase portraits near the fixed point are topologically the same (a much deeper fact, requiring the hypothesis of hyperbolicity). The article proves the first claim completely. It states the precise hypotheses under which the second becomes available, foreshadowing the Hartman-Grobman and Hyperbolicity theorem and the subsequent Classification of Planar Fixed Points. By the end you will be able to: compute the Jacobian of any smooth autonomous system, linearize at a fixed point, and interpret eigenvalues correctly. Crucially, you will also recognize the exact situation in which linearization fails to determine stability, with a worked counterexample showing why.
- The Jacobian is the matrix of partial derivatives of a vector field evaluated at a fixed point .
- Linearization replaces near by the linear system , .
- This is rigorously justified as the unique best linear (first-order Taylor) approximation to at .
- A fixed point is hyperbolic if no eigenvalue of has zero real part; only then is the local phase portrait guaranteed to match the linear one (Hartman–Grobman, foreshadowed here).
- Eigenvalues with nonzero real part correctly predict local stability/instability; purely imaginary or zero eigenvalues do not — the linearization is inconclusive.
- Key idea: the Jacobian converts a nonlinear stability question into an eigenvalue problem, valid to first order always, and valid qualitatively exactly when the fixed point is hyperbolic.
Where this lives today
In physics, linearizing the equations of a pendulum, oscillator network, or fluid flow about an equilibrium determines normal modes and whether small perturbations grow or decay, directly feeding into stability analyses in mechanics and plasma physics. In control engineering, the Jacobian at an operating point defines the state matrix used for pole placement, LQR design, and Kalman filtering of nonlinear plants — nearly all classical linear control theory begins by linearizing a nonlinear model this way. In ecology and epidemiology, the Jacobian at an equilibrium of a predator–prey or SIR-type model (evaluated at the disease-free or coexistence equilibrium) determines the basic reproduction number's sign structure and whether the equilibrium resists small outbreaks. In numerical analysis and optimization, Newton's method for root-finding is literally an iterated application of the same first-order Taylor approximation used in part (a), and the Jacobian appears identically in Newton–Raphson solvers for systems of nonlinear equations. In computer science and machine learning, Jacobians of layer maps appear in backpropagation and in analyzing the stability of recurrent neural network dynamics near fixed points. In cryptography-adjacent dynamical systems research, Lyapunov exponents (which generalize the eigenvalue real-part criterion along entire trajectories, not just at fixed points) are used to certify chaotic behavior in pseudo-random generators built from nonlinear maps.
Ask the tutor: How do the eigenvalues and eigenvectors of the Jacobian determine the specific shape (node, spiral, or saddle) of the phase portrait near a planar fixed point?
Let be a vector field on an open set , generating the autonomous system
Suppose is a fixed point, i.e. . The Jacobian matrix of at is the matrix of first partial derivatives
where and . The linearization of the system at is the constant-coefficient linear system
obtained by dropping all terms of order and higher in the Taylor expansion of about . The fixed point is called hyperbolic if every eigenvalue of has nonzero real part.
Intuition
Picture the vector field as an arrow attached to every point of the plane (or of ), telling a particle which way to move and how fast. At a fixed point the arrow vanishes: a particle placed exactly there stays forever. The interesting question is what happens to a particle placed near , and this is precisely where linearization earns its keep: sufficiently close to , the vector field looks almost exactly like a linear vector field, because that is what "differentiable" means. The Jacobian is the matrix that encodes this local linear vector field: it tells you, for a small displacement from , the (leading-order) velocity that the true nonlinear field produces. Two pictures help fix the idea. First, think of the graph of a single nonlinear function near a root : the tangent line is the one-dimensional shadow of exactly this construction, with the "Jacobian" reducing to the scalar derivative . Second, in two dimensions, the Jacobian's eigenvalues determine whether nearby trajectories are pulled in (stable node/spiral), pushed out (unstable node/spiral), or pass through in a hyperbolic saddle pattern — the classification developed in Classification of Planar Fixed Points. The figures below show a concrete nonlinear vector field, its linearization at a fixed point, and how closely the two agree in a small neighborhood while diverging further out.
Let be on an open set containing a fixed point (so ), and let . Write and let . Then:
(a) (Local Taylor approximation.) There is a function such that
Equivalently as , so is the unique linear map approximating to first order.
(b) (Hyperbolicity controls local stability.) If every eigenvalue of has negative real part, then is asymptotically stable for the full nonlinear system . If at least one eigenvalue of has positive real part, then is unstable for the full nonlinear system. (Part (b) is the Hartman–Grobman / Lyapunov linearization principle; hypothesis "hyperbolic," i.e. no eigenvalue with zero real part, is essential and is discussed further below and in Hartman-Grobman and Hyperbolicity.)
We prove (a) directly from multivariable Taylor's theorem, then prove (b) using a Lyapunov-function argument built from the linear theory.
Proof of (a). Since , Taylor's theorem with the Lagrange (or Peano) remainder form applied to each component at the point gives, for small enough that the segment from to lies in ,
where is the Hessian matrix of and is a point on the segment depending on and (this is the multivariable mean value form of the remainder, valid since ). Since is a fixed point, . Stacking the equations,
where is exactly the matrix with rows , i.e. the Jacobian as defined above. To bound , note means each Hessian is continuous, hence bounded on a compact neighborhood for some : there is with for all and all . Then for ,
by the definition of operator norm. Summing in quadrature over ,
Dividing by and letting shows , which is precisely the statement that is the (unique) best linear approximation to at : uniqueness follows because if also satisfies , subtracting gives , and evaluating along for fixed standard basis vector and forces column of to be zero for every , i.e. . This proves (a).
Proof of (b), stable case. Assume every eigenvalue of has real part for some . We invoke the standard fact from linear system theory (a consequence of the Jordan form / matrix exponential estimates, not dependent on the theorem being proved here) that there exists a symmetric positive definite matrix solving the Lyapunov equation
which exists precisely because has no eigenvalues on the imaginary axis with the correct sign structure (all eigenvalues in the open left half-plane); this is the standard continuous Lyapunov equation existence result, proved by taking , an integral that converges absolutely because for some when all eigenvalues of have real part . Define on a neighborhood of . Since is symmetric positive definite, for and , and there are constants (the extreme eigenvalues of ) with
Compute the derivative of along trajectories of the full nonlinear system :
By part (a), given there is such that whenever . Using Cauchy–Schwarz and the operator norm bound ,
Choose and let be the corresponding radius; then for ,
Thus is a strict Lyapunov function on the ball : away from , , and on trajectories away from . By the standard Lyapunov stability theorem (asymptotic stability from a strict Lyapunov function, itself independent of the present theorem), , i.e. , is an asymptotically stable fixed point of . This proves the stable case of (b).
Proof of (b), unstable case. Suppose has an eigenvalue with positive real part. Decompose where is the (nontrivial) sum of generalized eigenspaces for eigenvalues with positive real part and the sum for the rest. A standard instability argument (Chetaev's instability theorem, again a linear-algebra-based fact not circular with the present statement) constructs, from the spectral decomposition of restricted to , a quadratic function that is positive on a cone containing directions in and satisfies near along nonlinear trajectories in that cone, using the same first-order remainder bound from part (a) to control the nonlinear correction exactly as above. The existence of points arbitrarily close to inside this cone with , together with forcing to increase along the trajectory, shows the trajectory must leave any small ball around , which is precisely instability. This establishes the unstable case of (b), completing the proof.
∎Worked examples
Example 1 (asymmetric planar system — asymptotically stable spiral). Consider
Check is a fixed point: plugging in gives . Good. Compute the Jacobian. With and ,
At :
Find eigenvalues from :
Both eigenvalues have real part . By Theorem part (b), the origin is asymptotically stable for the nonlinear system, and moreover the negative real part with nonzero imaginary part predicts (foreshadowing Classification of Planar Fixed Points) that trajectories spiral into the origin rather than approaching along fixed directions. Note this conclusion required only the linear term; the cubic and quadratic terms and affect the picture far from the origin but are invisible to the Jacobian at , exactly as guaranteed by the remainder bound in part (a).
Example 2 (three-dimensional system with an explicit non-origin fixed point). Consider the system
First, locate a fixed point other than the origin (the origin is not a fixed point here, since ). Try to solve
From the second equation, . Substitute into the third: , i.e. . Testing : . Testing : , close. Rather than hunt numerically, pick a cleaner route: choose the fixed point to be exactly is inconvenient; instead verify has a root near , but to keep the Jacobian computation exact we instead exhibit the linearization at an arbitrary fixed point satisfying the three equations above, which suffices to illustrate the method without needing a closed-form root. Compute the Jacobian symbolically at a fixed point with , :
To make this concrete, take the numerically located root of : since the function satisfies and , there is a root by the Intermediate Value Theorem (continuity of ); refine: , , so (to three decimals). Then and . Numerically,
The characteristic polynomial is ; expanding along the first row,
Compute the bracket: . And the second bracket: . So
Expanding the product:
so the product equals . Adding :
Setting this to zero and multiplying by : . Evaluate at : . At : . So there is a real root between and — a positive real eigenvalue. By Theorem part (b), since at least one eigenvalue has positive real part, this fixed point is unstable. This illustrates that linearization at a non-origin, numerically located fixed point works exactly the same way, and again the instability conclusion follows purely from the sign pattern of the Jacobian's spectrum.
Drop the hypothesis that has no eigenvalue with zero real part, and consider
for a real parameter . The origin is a fixed point for every . The Jacobian at the origin is
independent of : purely imaginary, so the origin is not hyperbolic, regardless of . Convert to polar coordinates , . A direct computation using gives
so , and similarly (uniform rotation). Thus:
- If : for , so — the origin is asymptotically stable.
- If : for , so grows — the origin is unstable.
- If : , every circle is an invariant periodic orbit — the origin is a stable but not asymptotically stable center.
All three of these genuinely different nonlinear behaviors occur while the linearization is exactly the same rotation matrix with eigenvalues in every case. The linear system alone (a center, with all orbits closed circles) cannot distinguish from from : it predicts a center regardless of , which is correct only when and wrong (as a stability classification) otherwise. This shows precisely why Theorem part (b) requires hyperbolicity: when eigenvalues lie exactly on the imaginary axis, the remainder term — however small — determines the true qualitative behavior, and the linearization is uninformative about stability.
Scope, edge cases & common traps
| Situation | What linearization tells you | What it does NOT tell you |
|---|---|---|
| All eigenvalues of have negative real part | Asymptotic stability of for the nonlinear system (proved above) | Exact trajectories, basin of attraction size |
| At least one eigenvalue has positive real part | Instability of for the nonlinear system (proved above) | Which directions trajectories leave along, globally |
| Some eigenvalue has zero real part (non-hyperbolic) | Nothing about nonlinear stability | Stability is genuinely undetermined by alone; see counterexample |
| only , not | Part (a) with a weaker remainder still holds (differentiability alone gives this) | The clean quadratic remainder bound used in part (b)'s proof requires (or Lipschitz ) |
| Fixed point at | Same theorem, with | The Jacobian must be evaluated at , not at the origin |
The mathematician behind it
Origins · 1 minAleksandr Mikhailovich Lyapunov and how this was discovered
Lyapunov's 1892 doctoral thesis, The General Problem of the Stability of Motion, established both the linearization principle proved above (his "first method," valid precisely when the linearization is hyperbolic) and the direct, energy-like method of Lyapunov functions used in the proof of Theorem part (b). He worked in the tradition of Chebyshev's school in St. Petersburg, motivated by problems in celestial mechanics and the stability of rotating fluid masses, and his methods remain the standard toolkit for stability analysis in every modern textbook on nonlinear dynamics and control theory.
Is the Jacobian the same thing as the derivative?
Yes, in the multivariable sense: for a vector-valued function , the Jacobian matrix is the total derivative , the unique linear map satisfying . When it reduces to the familiar scalar derivative . The word "Jacobian" is often reserved for the matrix representation (the array of partial derivatives ), while "derivative" or "differential" refers to the linear map itself; they carry identical information once a basis (coordinates) is fixed, which is standard in .
Why does linearization only work near the fixed point, and how near is "near"?
The remainder bound is a statement about the limit as ; it guarantees the ratio vanishes in the limit but gives no explicit radius of validity without more information (a bound on the Hessian, as used in the proof). In practice the linearization is trustworthy in a neighborhood whose size depends on how large the second-derivative terms are and how far the eigenvalues of are from the imaginary axis (the "spectral gap"); the closer the fixed point is to non-hyperbolicity, the smaller this neighborhood tends to be, since the linear restoring force weakens relative to the nonlinear terms.
Does a stable linearization make the nonlinear system stable everywhere, or just locally?
Only locally. Theorem part (b) is inherently a statement about a (possibly small) neighborhood of ; the proof produces a specific radius inside which the Lyapunov function argument works, but says nothing about behavior far from . A system can have a locally asymptotically stable fixed point while trajectories starting far away diverge to infinity or approach a different attractor; establishing global stability requires separate techniques, such as constructing a Lyapunov function valid on the entire domain.
What if the fixed point is not at the origin — do I need a different formula?
No new formula is needed, only the substitution . You still compute the same partial-derivative matrix , but you evaluate it at rather than at , and the linear system is in the shifted coordinate . Example 2 above illustrates this: the fixed point was located by solving three equations simultaneously, and the Jacobian was evaluated at that specific point, not at the origin, since the origin was not even a fixed point of that system.
Can linearization fail even when hyperbolicity holds, due to higher-dimensional subtleties?
No — this is exactly the content of the Hartman–Grobman theorem (foreshadowed here, proved in full in Hartman-Grobman and Hyperbolicity): whenever the fixed point is hyperbolic, there is a continuous, invertible change of coordinates (a homeomorphism) taking the nonlinear flow near to the linear flow of near , valid in any finite dimension . The stability conclusion proved in this article (part (b)) is a consequence of that stronger topological statement, though we proved stability directly via Lyapunov functions without needing the full conjugacy.
Why did the proof need C² instead of just C¹?
Differentiability alone () gives , which is enough to define the linearization and prove part (a) in its basic form. However the rate estimate used in the stability proof (part (b)) requires a uniform bound on second derivatives (or at least a Lipschitz bound on ) so that the quadratic remainder in Taylor's theorem is controlled uniformly near ; without this, the Lyapunov function argument's cancellation cannot be guaranteed to hold on a fixed-size neighborhood.
How does this relate to Newton's method?
Newton's method for solving iterates , which is precisely the linear approximation from part (a) solved for the root of the linearized equation . The same Taylor expansion and remainder estimate used to justify linearization near a dynamical fixed point also justifies the quadratic convergence rate of Newton's method near a simple root, making this article's Theorem part (a) a shared foundation for both stability theory and root-finding numerics.