Eigenvalue applications and synthesis
You have already learned how to find a matrix's eigenvalues and eigenvectors. This topic asks: so what? Two payoffs follow directly. Diagonalization rewrites as , a form where computing for any — even a huge one — takes one matrix inversion instead of multiplications. The Cayley–Hamilton theorem says every square matrix satisfies its own characteristic equation, , which sounds abstract but is a genuinely practical tool: rearrange it to find without cofactors, or use it to collapse a high power into a short combination of and . Together these two ideas are the capstone of the vector-spaces-and-eigenvalues unit — the moment the machinery of eigenvalues starts paying rent. Numerical eigenvalue algorithms, the Jordan form, and eigenvalue methods for differential equations stay out of range here.
Diagonalizing turns powers of into powers of a diagonal matrix, and the Cayley–Hamilton theorem turns the characteristic polynomial into a working formula for and for reducing high powers of .
The core idea
Diagonalization exists when eigenvectors are independent. If matrix has linearly independent eigenvectors — equivalently, geometric multiplicity equals algebraic multiplicity for every eigenvalue — then stacking the eigenvectors as columns of and the matching eigenvalues on the diagonal of gives
where: is the eigenvector matrix (column is the eigenvector for eigenvalue ), is diagonal with in the same order as 's columns, and undoes the change of basis. Every real symmetric (and every Hermitian) matrix is automatically diagonalizable; a distinct-eigenvalues matrix is too, since eigenvectors from distinct eigenvalues are always independent — that shortcut saves you from checking eigenspace dimensions by hand.
Why this makes powers cheap. A diagonal matrix's powers are trivial entrywise, , and substituting into gives for any , using only one inversion of regardless of how large is. The same trick with gives a second route to the inverse, , valid whenever every .
Cayley–Hamilton reframes the characteristic polynomial as an identity in itself. If , then substituting for (and for the constant term) gives the zero matrix, . For matrices this is
where: is the sum of the diagonal entries and is the determinant — both readable off directly, no eigenvalues required. Two standard payoffs: rearrange to isolate and divide by to get (when ); or repeatedly substitute to write any as , avoiding direct multiplications.
Two independent toolkits, not competitors. Diagonalization needs eigenvectors and only exists when is invertible, but once available it handles any power in one shot. Cayley–Hamilton needs nothing beyond and for a matrix, holds for every square matrix without exception, and reduces powers one step at a time rather than jumping straight to . Recognizing which one a problem is steering you toward — an explicit "diagonalize and find " instruction versus a bare "find " or "simplify " — is itself half the battle in this topic.
The goal is to show, starting only from the definition and the fact that powers of a diagonal matrix act entrywise, that for every positive integer , so that computing an arbitrarily large power of costs one matrix inversion rather than matrix multiplications.
Step 1. Write using the diagonalization directly: . The middle product collapses, leaving .
Step 2. Repeat the same cancellation for . Every time a pair meets in the middle it vanishes to , so the pattern continues indefinitely: for any positive integer .
Step 3. Use that is diagonal, so is found without any matrix multiplication at all: , since a diagonal matrix's powers act independently on each diagonal entry.
Step 4. Assemble the result: . The only "hard" step in the entire calculation, for any , is the single inversion — everything else is one matrix multiplication on each side and raising scalars to the power . This is why diagonalization is the standard route whenever a large power of a matrix is required.
Worked example
Problem. Diagonalize , use it to compute , and then verify two independent ways.
Step 1. From the eigenvalue computation for this matrix (previous topic), with eigenvector , and with eigenvector . Build , .
Step 2. Invert : , so .
Step 3. Apply with . First , then multiplying by and simplifying each entry gives
This matches direct multiplication (, gives the same matrix), confirming the diagonalization route.
Answer: .
Competitive stretch
Find two ways for the same , to see diagonalization and Cayley–Hamilton agree. Via diagonalization, with , which works out to . Via Cayley–Hamilton, , , so , rearranged to — the identical matrix, reached without ever computing an eigenvector. Notice the trade-off in effort: the diagonalization route needed the eigenvalues and eigenvectors from the previous topic plus two matrix multiplications, while the Cayley–Hamilton route needed only a trace and a determinant read straight off . When only is wanted — not a general power — Cayley–Hamilton is usually the faster path for a matrix, since it skips the eigenvector computation entirely.
Common traps
- Writing when does not actually have independent eigenvectors — check geometric multiplicity equals algebraic multiplicity for every eigenvalue first, or is singular and the formula is meaningless.
- Mismatching column order: column of must be the eigenvector for the eigenvalue sitting in position of — swapping the order silently gives the wrong matrix.
- In Cayley–Hamilton, forgetting the constant term multiplies the identity matrix , not the scalar — the equation is , a matrix equation, never a scalar one.
- Assuming the shortcut works for a non-diagonalizable matrix — Cayley–Hamilton itself still holds (it needs no diagonalizability), but the clean power formula needs invertible.
Ask the tutor: want to work through diagonalizing a matrix or using Cayley–Hamilton to simplify a higher power step by step?
Why bother diagonalizing at all if I can already multiply matrices directly?
Direct multiplication to get costs matrix multiplications, which becomes painful for large and is genuinely impractical for something like . Diagonalization trades that for a single matrix inversion plus raising each eigenvalue to the power — arithmetic on numbers, not matrices. The one-time cost of finding eigenvalues, eigenvectors, and pays for itself the moment is large or you need several different powers of the same .
Does Cayley-Hamilton work for every matrix, even ones that are not diagonalizable?
Yes — that is exactly its appeal. The theorem follows from the characteristic polynomial alone and makes no assumption about independent eigenvectors, so it holds for every square matrix. What is restricted to diagonalizable matrices is the separate shortcut ; Cayley–Hamilton's own power-reduction trick (repeatedly substituting ) works regardless.
How do I decide whether to use diagonalization or Cayley-Hamilton for a given problem?
If eigenvalues and eigenvectors are already known or easy to find and you need a very high power, diagonalization is direct. If you only need , or a modestly high power, and you would rather avoid eigenvectors altogether, Cayley–Hamilton is often faster since it needs only and for a matrix. Both always give the same answer when both apply — use whichever needs less setup for the specific problem. A good habit: read what the question actually names. "Diagonalize and hence find" is a diagonalization signal; "use Cayley–Hamilton to find" removes the choice entirely.