Eigenvalue applications and synthesis

You have already learned how to find a matrix's eigenvalues and eigenvectors. This topic asks: so what? Two payoffs follow directly. Diagonalization rewrites AA as PDP−1PDP^{-1}, a form where computing AkA^k for any kk — even a huge one — takes one matrix inversion instead of k−1k-1 multiplications. The Cayley–Hamilton theorem says every square matrix satisfies its own characteristic equation, p(A)=Op(A)=O, which sounds abstract but is a genuinely practical tool: rearrange it to find A−1A^{-1} without cofactors, or use it to collapse a high power AkA^k into a short combination of AA and II. Together these two ideas are the capstone of the vector-spaces-and-eigenvalues unit — the moment the machinery of eigenvalues starts paying rent. Numerical eigenvalue algorithms, the Jordan form, and eigenvalue methods for differential equations stay out of range here.

The core insight

Diagonalizing A=PDP−1A=PDP^{-1} turns powers of AA into powers of a diagonal matrix, and the Cayley–Hamilton theorem p(A)=Op(A)=O turns the characteristic polynomial into a working formula for A−1A^{-1} and for reducing high powers of AA.

The core idea

Diagonalization exists when eigenvectors are independent. If n×nn\times n matrix AA has nn linearly independent eigenvectors v1,…,vn\mathbf v_1,\dots,\mathbf v_n — equivalently, geometric multiplicity equals algebraic multiplicity for every eigenvalue — then stacking the eigenvectors as columns of P=[v1 ⋯ vn]P=[\mathbf v_1\ \cdots\ \mathbf v_n] and the matching eigenvalues on the diagonal of DD gives

A=PDP−1.A=PDP^{-1}.

where: PP is the eigenvector matrix (column jj is the eigenvector for eigenvalue jj), DD is diagonal with Djj=λjD_{jj}=\lambda_j in the same order as PP's columns, and P−1P^{-1} undoes the change of basis. Every real symmetric (and every Hermitian) matrix is automatically diagonalizable; a distinct-eigenvalues matrix is too, since eigenvectors from distinct eigenvalues are always independent — that shortcut saves you from checking eigenspace dimensions by hand.

Why this makes powers cheap. A diagonal matrix's powers are trivial entrywise, Dk=diag⁡(λ1k,…,λnk)D^k=\operatorname{diag}(\lambda_1^k,\dots,\lambda_n^k), and substituting into A=PDP−1A=PDP^{-1} gives Ak=PDkP−1A^k=PD^kP^{-1} for any kk, using only one inversion of PP regardless of how large kk is. The same trick with k=−1k=-1 gives a second route to the inverse, A−1=PD−1P−1A^{-1}=PD^{-1}P^{-1}, valid whenever every λi≠0\lambda_i\neq0.

Cayley–Hamilton reframes the characteristic polynomial as an identity in AA itself. If p(λ)=det⁡(A−λI)p(\lambda)=\det(A-\lambda I), then substituting AA for λ\lambda (and II for the constant term) gives the zero matrix, p(A)=Op(A)=O. For 2×22\times2 matrices this is

A2−(tr⁡A) A+(det⁡A) I=O,A^2-(\operatorname{tr}A)\,A+(\det A)\,I=O,

where: tr⁡A\operatorname{tr}A is the sum of the diagonal entries and det⁡A\det A is the determinant — both readable off AA directly, no eigenvalues required. Two standard payoffs: rearrange to isolate II and divide by det⁡A\det A to get A−1A^{-1} (when det⁡A≠0\det A\neq0); or repeatedly substitute A2=(tr⁡A)A−(det⁡A)IA^2=(\operatorname{tr}A)A-(\det A)I to write any AkA^k as αA+βI\alpha A+\beta I, avoiding k−1k-1 direct multiplications.

Two independent toolkits, not competitors. Diagonalization needs eigenvectors and only exists when PP is invertible, but once available it handles any power in one shot. Cayley–Hamilton needs nothing beyond tr⁡A\operatorname{tr}A and det⁡A\det A for a 2×22\times2 matrix, holds for every square matrix without exception, and reduces powers one step at a time rather than jumping straight to AkA^k. Recognizing which one a problem is steering you toward — an explicit "diagonalize and find AkA^k" instruction versus a bare "find A−1A^{-1}" or "simplify AkA^k" — is itself half the battle in this topic.

Figure
Two payoff routes branch from the eigenvalue problem, one leading to diagonalization and matrix powers, the other leading to the characteristic polynomial and the Cayley Hamilton theorem
From eigenvalues to two computational payoffs Eigenvalues and eigenvectors of A Diagonalization A = P D P⁻¹ Cayley-Hamilton p(A) = O A to the power k = P D to the power k P⁻¹ one inversion, any k A inverse from rearranging p(A) = O and high powers reduced to alpha A plus beta I Same starting point, two independent toolkits for matrix powers and inverses
Derivation APowers of a matrix via diagonalization

The goal is to show, starting only from the definition A=PDP−1A=PDP^{-1} and the fact that powers of a diagonal matrix act entrywise, that Ak=PDkP−1A^k=PD^kP^{-1} for every positive integer kk, so that computing an arbitrarily large power of AA costs one matrix inversion rather than k−1k-1 matrix multiplications.

Step 1. Write A2A^2 using the diagonalization directly: A2=(PDP−1)(PDP−1)=PD(P−1P)DP−1A^2=(PDP^{-1})(PDP^{-1})=PD(P^{-1}P)DP^{-1}. The middle product P−1P=IP^{-1}P=I collapses, leaving A2=PDIDP−1=PD2P−1A^2=PDIDP^{-1}=PD^2P^{-1}.

Step 2. Repeat the same cancellation for A3=A2⋅A=(PD2P−1)(PDP−1)=PD2(P−1P)DP−1=PD3P−1A^3=A^2\cdot A=(PD^2P^{-1})(PDP^{-1})=PD^2(P^{-1}P)DP^{-1}=PD^3P^{-1}. Every time a P−1PP^{-1}P pair meets in the middle it vanishes to II, so the pattern continues indefinitely: Ak=PDkP−1A^k=PD^kP^{-1} for any positive integer kk.

Step 3. Use that DD is diagonal, so DkD^k is found without any matrix multiplication at all: Dk=diag⁡(λ1k,λ2k,…,λnk)D^k=\operatorname{diag}(\lambda_1^k,\lambda_2^k,\dots,\lambda_n^k), since a diagonal matrix's powers act independently on each diagonal entry.

Step 4. Assemble the result: Ak=Pdiag⁡(λ1k,…,λnk)P−1A^k=P\operatorname{diag}(\lambda_1^k,\dots,\lambda_n^k)P^{-1}. The only "hard" step in the entire calculation, for any kk, is the single inversion P−1P^{-1} — everything else is one matrix multiplication on each side and raising scalars to the power kk. This is why diagonalization is the standard route whenever a large power of a matrix is required.

Worked example

Problem. Diagonalize A=(4123)A=\begin{pmatrix}4&1\\2&3\end{pmatrix}, use it to compute A3A^3, and then verify A−1A^{-1} two independent ways.

Step 1. From the eigenvalue computation for this matrix (previous topic), λ1=5\lambda_1=5 with eigenvector v1=(1,1)\mathbf v_1=(1,1), and λ2=2\lambda_2=2 with eigenvector v2=(1,−2)\mathbf v_2=(1,-2). Build P=(111−2)P=\begin{pmatrix}1&1\\1&-2\end{pmatrix}, D=(5002)D=\begin{pmatrix}5&0\\0&2\end{pmatrix}.

Step 2. Invert PP: det⁡P=1(−2)−1(1)=−3\det P=1(-2)-1(1)=-3, so P−1=1−3(−2−1−11)=(2/31/31/3−1/3)P^{-1}=\dfrac{1}{-3}\begin{pmatrix}-2&-1\\-1&1\end{pmatrix}=\begin{pmatrix}2/3&1/3\\1/3&-1/3\end{pmatrix}.

Step 3. Apply A3=PD3P−1A^3=PD^3P^{-1} with D3=(125008)D^3=\begin{pmatrix}125&0\\0&8\end{pmatrix}. First PD3=(1258125−16)PD^3=\begin{pmatrix}125&8\\125&-16\end{pmatrix}, then multiplying by P−1P^{-1} and simplifying each entry gives

A3=(86397847).A^3=\begin{pmatrix}86&39\\78&47\end{pmatrix}.

This matches direct multiplication (A2=(1871411)A^2=\begin{pmatrix}18&7\\14&11\end{pmatrix}, A3=A2AA^3=A^2A gives the same matrix), confirming the diagonalization route.

Answer: A3=(86397847)A^3=\begin{pmatrix}86&39\\78&47\end{pmatrix}.

Competitive stretch

Find A−1A^{-1} two ways for the same AA, to see diagonalization and Cayley–Hamilton agree. Via diagonalization, A−1=PD−1P−1A^{-1}=PD^{-1}P^{-1} with D−1=diag⁡(1/5,1/2)D^{-1}=\operatorname{diag}(1/5,1/2), which works out to 110(3−1−24)\dfrac{1}{10}\begin{pmatrix}3&-1\\-2&4\end{pmatrix}. Via Cayley–Hamilton, tr⁡A=7\operatorname{tr}A=7, det⁡A=10\det A=10, so A2−7A+10I=OA^2-7A+10I=O, rearranged to A−1=7I−A10=110(3−1−24)A^{-1}=\dfrac{7I-A}{10}=\dfrac{1}{10}\begin{pmatrix}3&-1\\-2&4\end{pmatrix} — the identical matrix, reached without ever computing an eigenvector. Notice the trade-off in effort: the diagonalization route needed the eigenvalues and eigenvectors from the previous topic plus two matrix multiplications, while the Cayley–Hamilton route needed only a trace and a determinant read straight off AA. When only A−1A^{-1} is wanted — not a general power — Cayley–Hamilton is usually the faster path for a 2×22\times2 matrix, since it skips the eigenvector computation entirely.

Common traps

  • Writing A=PDP−1A=PDP^{-1} when AA does not actually have nn independent eigenvectors — check geometric multiplicity equals algebraic multiplicity for every eigenvalue first, or PP is singular and the formula is meaningless.
  • Mismatching column order: column jj of PP must be the eigenvector for the eigenvalue sitting in position jj of DD — swapping the order silently gives the wrong matrix.
  • In Cayley–Hamilton, forgetting the constant term multiplies the identity matrix II, not the scalar 11 — the equation is p(A)=Op(A)=O, a matrix equation, never a scalar one.
  • Assuming the Ak=PDkP−1A^k=PD^kP^{-1} shortcut works for a non-diagonalizable matrix — Cayley–Hamilton itself still holds (it needs no diagonalizability), but the clean power formula needs PP invertible.

Ask the tutor: want to work through diagonalizing a 3×33\times3 matrix or using Cayley–Hamilton to simplify a higher power step by step?

Why bother diagonalizing at all if I can already multiply matrices directly?

Direct multiplication to get AkA^k costs k−1k-1 matrix multiplications, which becomes painful for large kk and is genuinely impractical for something like A50A^{50}. Diagonalization trades that for a single matrix inversion plus raising each eigenvalue to the power kk — arithmetic on numbers, not matrices. The one-time cost of finding eigenvalues, eigenvectors, and P−1P^{-1} pays for itself the moment kk is large or you need several different powers of the same AA.

Does Cayley-Hamilton work for every matrix, even ones that are not diagonalizable?

Yes — that is exactly its appeal. The theorem p(A)=Op(A)=O follows from the characteristic polynomial alone and makes no assumption about independent eigenvectors, so it holds for every square matrix. What is restricted to diagonalizable matrices is the separate shortcut Ak=PDkP−1A^k=PD^kP^{-1}; Cayley–Hamilton's own power-reduction trick (repeatedly substituting A2=(tr⁡A)A−(det⁡A)IA^2=(\operatorname{tr}A)A-(\det A)I) works regardless.

How do I decide whether to use diagonalization or Cayley-Hamilton for a given problem?

If eigenvalues and eigenvectors are already known or easy to find and you need a very high power, diagonalization is direct. If you only need A−1A^{-1}, or a modestly high power, and you would rather avoid eigenvectors altogether, Cayley–Hamilton is often faster since it needs only tr⁡A\operatorname{tr}A and det⁡A\det A for a 2×22\times2 matrix. Both always give the same answer when both apply — use whichever needs less setup for the specific problem. A good habit: read what the question actually names. "Diagonalize and hence find" is a diagonalization signal; "use Cayley–Hamilton to find" removes the choice entirely.

Before this

Where this leads