The Cayley-Hamilton Theorem
Can a matrix be plugged into its own characteristic polynomial? It sounds like a category error. The polynomial eats scalars, not matrices. But once we agree that becomes , and multiplication of scalars becomes matrix multiplication, the substitution makes perfect sense. The astonishing fact, discovered independently by Cayley and Hamilton in the mid-19th century, is that the resulting matrix is zero. Every square matrix annihilates its own characteristic polynomial. This is not a tautology. The tempting one-line "proof" — substitute into — is nonsense. This is because is a statement about a scalar. It is not a statement about the matrix-valued expression . The theorem requires a genuine argument. Working through why the naive argument fails is one of the best ways to appreciate what is really being claimed. The result sits at the crossroads of the Characteristic Polynomial and the Minimal Polynomial. It guarantees that the minimal polynomial always divides the characteristic polynomial. This fact is the engine behind the classification of operators up to similarity. It is the reason every operator decomposes into generalized eigenspaces. It is the reason Jordan form and rational canonical form exist. It is also a workhorse for computing matrix inverses and powers by hand. Its reach extends into control theory, numerical linear algebra, and the structure theory of modules over polynomial rings. This article gives a fully rigorous proof via triangularization. It explains precisely why the substitution shortcut fails. It works two concrete asymmetric examples. It also shows what breaks when the field is not algebraically closed. We examine what breaks when the "proof" ignores commutativity subtleties. We close by connecting the theorem to the generalized eigenspace decomposition and the rational canonical form.
- Every linear operator on a finite-dimensional vector space satisfies , where is its characteristic polynomial.
- The proof uses Triangularization of Operators: over an algebraically closed field (or after extending scalars), every operator is similar to an upper-triangular matrix.
- The naive "plug in " argument is invalid because is scalar-valued in , while is a matrix; the two live in different algebraic worlds.
- A direct corollary: the minimal polynomial of divides the characteristic polynomial of .
- The theorem holds over every field, not just , via a field-extension or adjugate-matrix argument.
- Key idea: an operator can always be triangularized after extending scalars, and a triangular operator visibly kills its own characteristic polynomial one factor at a time.
Where this lives today
The Cayley–Hamilton theorem is a load-bearing wall in the structure theory of linear operators. It immediately yields that the minimal polynomial divides the characteristic polynomial (proved above), which is the starting point for the Generalized Eigenspace Decomposition: factoring the characteristic polynomial into powers of irreducible factors lets one decompose into -invariant generalized eigenspaces, ultimately producing Jordan canonical form over algebraically closed fields and the Rational Canonical Form over arbitrary fields. In control theory, Cayley–Hamilton underlies the Cayley–Hamilton method for computing the matrix exponential in closed form as a polynomial in of degree less than , crucial for solving linear ODE systems symbolically. In numerical linear algebra, the theorem justifies expressing as a polynomial in (as in Example 2), which underlies iterative schemes for matrix inversion and for computing functions of matrices without diagonalizing. In algebraic graph theory, the theorem constrains the powers of an adjacency matrix, since any power can be re-expressed via lower powers, controlling the growth of walk-counting sequences. In cryptography and coding theory, recurrences derived from characteristic polynomials of companion matrices (linear feedback shift registers) are a direct application of the same algebraic mechanism. In commutative algebra, the determinant-trick generalization of Cayley–Hamilton (for matrices over a commutative ring, using the adjugate) is the key technical lemma behind the Nakayama lemma and integral dependence, connecting this classical linear-algebra fact to modern algebraic geometry and number theory.
Ask the tutor: How does Cayley–Hamilton's guarantee that get used to build the generalized eigenspace decomposition of an operator?
Let be a finite-dimensional vector space over a field , with , and let be a linear operator. Let
be the characteristic polynomial of (computed, e.g., from any matrix representation of ; it is independent of the choice of basis since similar matrices have the same characteristic polynomial). Write
Define the operator
The Cayley–Hamilton Theorem asserts:
the zero operator on . Equivalently, for any matrix over with characteristic polynomial , we have as an zero matrix.
Intuition
The apparent shortcut is seductive: " vanishes when , since ." This sentence contains a category confusion. The polynomial is built by taking a determinant of a matrix whose entries are polynomials in the scalar ; it is a scalar-valued function of the scalar variable . The object , by contrast, is built by first computing the scalar coefficients , and then forming the honestly matrix-valued combination . Setting "" inside the determinant would require making sense of where is the zero matrix of operators — but that is a different, degenerate computation that tells us nothing about . There is no valid algebraic manipulation that turns one into the other without extra work. The theorem is true, but it needs a genuine proof. The right mental picture comes from triangular matrices. If is upper triangular with diagonal entries , then
and one can show that the operators , applied in sequence to any vector, successively collapse it into smaller and smaller triangular subspaces, eventually reaching . Every operator over an algebraically closed field (and, after a scalar extension trick, over any field) is similar to such a triangular matrix, by Triangularization of Operators. This is the geometric heart of the proof: each linear factor of the characteristic polynomial "eats" one more dimension of a triangularizing flag.
Theorem
Let be any field, let be a finite-dimensional vector space over with , and let be a linear operator with characteristic polynomial . Then
Let be finite-dimensional over , , and suppose has an upper-triangular matrix representation with respect to some basis , with diagonal entries (in that order). Then
and .
Step 1: the characteristic polynomial of a triangular matrix. If is the upper-triangular matrix of in the basis , then is also upper triangular, with diagonal entries . The determinant of an upper-triangular matrix is the product of its diagonal entries (expand by cofactors along the first column repeatedly, or induct on : expanding along the first column, the only nonzero entry is the entry , times the determinant of the upper-triangular lower-right block). Hence
Step 2: the flag structure. Let for (with ). Since is upper triangular in this basis, for every (the -th column of has zero entries below row ). Hence for all : the form a -invariant flag. Moreover, for each , the diagonal entry is exactly the coefficient of in , so
Since and maps into (as does and trivially does), we get
Step 3: composing the factors. Define the operator
Since all the factors are polynomials in , they commute with each other; the order of composition can be rearranged freely, and in particular
because expanded is exactly , and evaluating a product of commuting linear factors at gives the corresponding product of operators , in any order, by distributivity of composition over the (commutative) polynomial ring generated by . We show by showing for every basis vector , ; since is a basis, this gives on all of . Fix . Apply the factors of to in the order first, then , etc. (valid since all factors commute):
More precisely, we argue by induction on the number of factors applied. Let . By , applying to any vector of lands in . We apply the factors in the order (a valid reordering of the commuting product , together with the remaining unused factors which we insert afterward and which map to harmlessly — see below):
- , using with .
- Since is invariant, and applied at level says , we get .
- Inductively, after applying for in decreasing order, we obtain .
So the composite already sends to . The full operator is this composite multiplied by the remaining commuting factors , applied in any order since all factors commute; applying a linear operator to the zero vector gives zero, so . Since was arbitrary and spans , we conclude , i.e. .
∎Technique: reduction to the triangularizable case via field extension, using <a class="wiki-link" href="/wiki/math-linalg-triangularization" data-track="wiki_article.body.wiki_link">Triangularization of Operators</a>. Case 1: is algebraically closed (e.g. ). By the theorem on Triangularization of Operators, since splits completely into linear factors over (as is algebraically closed), has an upper-triangular matrix representation with respect to some basis of . By the Lemma just proved, . Case 2: general . Let be the matrix of in some fixed basis of ; is an matrix over . Let be an algebraic closure of (every field embeds in an algebraically closed field; this is a standard fact from field theory, used here only as scaffolding, not circularly invoking anything about ). View as a matrix over , defining an operator on by matrix multiplication by . The characteristic polynomial of computed over , namely , is the same polynomial as the characteristic polynomial of computed over : the determinant is a universal polynomial expression (the Leibniz expansion) in the entries of , and these entries do not change when we merely regard the matrix as having entries in the larger field . Hence as elements of . By Case 1 (applied to on , since is algebraically closed), , i.e. as a matrix over . But is computed from and the coefficients using only field operations that stay inside (matrix addition and scalar multiplication by elements of , applied to the matrix which has entries in ); so , as computed over , is literally the same matrix as computed over — it is an -matrix that happens to also be regarded as an -matrix, and we've shown that matrix is . Hence over as well, i.e. . This completes the proof for arbitrary fields .
∎Let be a linear operator on a finite-dimensional vector space over , with minimal polynomial and characteristic polynomial . Then in .
By definition, the Minimal Polynomial is the monic polynomial of least degree such that , and every polynomial with is a multiple of — this divisibility property is itself a standard consequence of polynomial division: write with (division algorithm in ); then , and minimality of forces . By the Cayley–Hamilton Theorem, . Applying the divisibility property above with gives .
∎Worked examples
Example 1 (a genuinely asymmetric matrix). Let
Step 1: characteristic polynomial. Compute :
Expand along the first row:
The first minor is . The second minor is . So
Expand : first , then . So
Step 2: verify Cayley–Hamilton numerically. We must check
Compute :
Row 1: . Row 2: . Row 3: .
Compute : Row 1: . Row 2: . Row 3: .
Now compute entrywise. Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Entry : . ✓ Every entry vanishes: , confirming Cayley–Hamilton for this genuinely non-symmetric matrix with distinct off-diagonal structure.
Example 2 (using Cayley–Hamilton to compute and a high power efficiently). Take the same as above, with . Cayley–Hamilton gives
Compute using found above:
Entry : . Entry : . Entry : . Entry : . Entry : . Entry : . Entry : . Entry : . Entry : .
Check: should equal ; recall for a monic , we have . Here , so , consistent with dividing by above and matching a nonzero determinant (so is indeed invertible, justifying this computation). We can quickly verify one entry of : row 1 of times column 1 of (before dividing by 5): , and . ✓ Row 1 times column 2: , and . ✓ This matches the identity matrix's first row, confirming the inverse. This illustrates the practical power of the theorem: it expresses (and, iterating the same recursion , arbitrarily high powers ) purely in terms of — a huge computational shortcut compared to repeated matrix multiplication or Gaussian elimination from scratch.
The theorem's conclusion holds over every field — that is Case 2 above. But it is instructive to see why the triangularization-based proof genuinely breaks down over a non-algebraically-closed field if one refuses to extend scalars, and why the naive fix "just triangularize over " fails. Let and consider
representing rotation by . Its characteristic polynomial is
which has no real roots. Consequently there is no basis of in which becomes upper triangular with real diagonal entries — a real triangularization would force the diagonal entries to be eigenvalues of in , and has none (a rotation by fixes no real line). So the Lemma proved above literally cannot be applied directly to over : the hypothesis " has an upper-triangular matrix representation over " fails. This is exactly why the general proof of Cayley–Hamilton passes to the algebraic closure : over , is triangularizable (indeed diagonalizable, with eigenvalues ), the Lemma applies there, and we transport the conclusion back down to because the identity is a system of polynomial equations in the entries of with coefficients in , so its truth over the larger field implies its truth over . Concretely, one still checks holds over :
so — the theorem's conclusion is true — but the route to proving it required the field-extension step, since the direct real-triangularization hypothesis of the Lemma is unavailable. This shows precisely which hypothesis (triangularizability over the field at hand) is doing the work in the Lemma, and why the full theorem's proof must route around it via .
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| algebraically closed (e.g. ) | Direct triangularization applies; Lemma gives the result immediately. |
| not algebraically closed (e.g. ) | Theorem still true, proved via extension to (or via the universal adjugate-matrix identity, an alternative proof not covered in detail here). |
| diagonalizable | still requires the full argument; diagonalizability is a stronger condition than Cayley–Hamilton and is not needed for it. |
| nilpotent | , and Cayley–Hamilton says — consistent with (but weaker than) the definition of nilpotency, which may give for some already. |
| Substituting directly into | Invalid. is a scalar polynomial; is a true but different, vacuous statement, not equal to . |
| Infinite-dimensional | Theorem does not directly apply; "characteristic polynomial" is not generally defined, and the finite-dimensionality hypothesis is essential. |
The mathematician behind it
Origins · 1 minArthur Cayley and how this was discovered
Arthur Cayley was one of the founders of the modern theory of matrices, publishing the first systematic treatment of matrix algebra as an independent object of study (rather than merely bookkeeping for linear substitutions) in his 1858 Memoir on the Theory of Matrices. He verified the theorem now named for him and William Rowan Hamilton explicitly for and matrices, remarking that he had "not thought it necessary to undertake the labour of a formal proof" for general — a proof supplied rigorously only later. Cayley worked prolifically across algebra, geometry, and invariant theory, producing over 900 papers, and his matrix-theoretic viewpoint — treating an array of numbers as a single algebraic entity obeying its own arithmetic — reshaped how mathematicians conceived of linear transformations.
Is the "substitute " shortcut ever rigorously fixable, or is it just wrong?
It cannot be fixed as literally stated, because it compares two different objects. The polynomial is computed by expanding a determinant whose entries are polynomials in the scalar ; evaluating this scalar polynomial at is not defined by the determinant formula at all, since determinants are only defined for matrices with entries in a commutative ring, and "" as a matrix of operators over the noncommutative-in-general setting of matrix-valued entries does not literally fit the determinant formula in the same way. What is true and rigorous is the completely different statement: expand to get honest scalar coefficients , and then separately ask whether . That equality is the real content of Cayley–Hamilton and needs its own proof.
Does Cayley–Hamilton say that is the smallest polynomial killing ?
No — that is a common overreach. Cayley–Hamilton only guarantees ; it says nothing about minimality. The polynomial of least degree annihilating is by definition the minimal polynomial , and Cayley–Hamilton's true consequence is the one-directional divisibility , not equality. For example, the identity matrix has characteristic polynomial but minimal polynomial simply , since already. Equality holds precisely when is "cyclic" (has a cyclic vector), a strictly stronger condition tied to the rational canonical form having a single companion block.
Why does the proof need triangularization rather than diagonalization?
Not every operator is diagonalizable, but by the theorem on Triangularization of Operators, every operator is triangularizable as soon as its characteristic polynomial splits into linear factors over the field — a strictly weaker requirement than diagonalizability. Working with the more general triangular form lets the proof apply uniformly to all operators (over an algebraically closed field), including defective ones like nontrivial Jordan blocks, without needing to first separately handle the diagonalizable and non-diagonalizable cases.
Does Cayley–Hamilton hold for matrices over rings that are not fields, like ?
Yes, with an appropriately adapted proof. The version for commutative rings is usually proved using the adjugate (classical adjoint) matrix identity applied to over the polynomial ring , comparing coefficients after expanding as a polynomial in with matrix coefficients. This ring-theoretic version, sometimes attributed to the determinant trick used in commutative algebra, is the form used to prove results like the Nakayama lemma, and it does not rely on triangularization at all, since triangularization can fail badly over rings that are not fields.
Can Cayley–Hamilton be used to compute matrix powers efficiently?
Yes, this is one of its most practical uses. If , then , giving a linear recurrence expressing (and, inductively, every higher power) in terms of . This turns the problem of computing for large into solving a linear recurrence with characteristic polynomial , which can be done in closed form using the eigenvalues of , avoiding successive matrix multiplications.
Does the theorem depend on choice of basis?
No. The characteristic polynomial is basis-independent: if and are similar matrices representing the same operator in different bases, then , using multiplicativity of the determinant. Consequently is an invariant of the operator itself, not of any particular matrix representation, and the statement is a basis-free statement about the operator.