Eigenvalues and eigenvectors

Multiply almost any vector by a square matrix AA and it gets rotated as well as stretched — its direction changes unpredictably. A handful of special directions escape this fate: multiplying by AA merely stretches or shrinks them, never rotates them. These directions are the eigenvectors of AA, and the stretch factor along each one is its eigenvalue. This single pair (λ,v)(\lambda,\mathbf v) is the organizing idea behind diagonalization, matrix powers, stability analysis, and much of the applied mathematics you will meet after this course. It builds directly on the matrix algebra (determinants, rank) and linear-transformation results from earlier in the unit, and it sets up everything that follows in vector spaces and eigenvalue problems. Numerical algorithms for finding eigenvalues (power method, QR iteration) are out of scope here — only the algebraic characteristic-equation approach is used.

The core insight

An eigenvector of AA is a nonzero direction that AA only stretches by a factor λ\lambda (its eigenvalue), found by solving det⁡(A−λI)=0\det(A-\lambda I)=0 and then the homogeneous system (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0.

The core idea

A nonzero vector v\mathbf v is an eigenvector of a square matrix AA (n×nn\times n) with eigenvalue λ\lambda if multiplying by AA reproduces v\mathbf v scaled by λ\lambda:

Av=λv,v≠0.A\mathbf v=\lambda\mathbf v,\qquad \mathbf v\neq\mathbf 0.

where: AA is the n×nn\times n matrix, v\mathbf v is the eigenvector (a nonzero column vector), and λ\lambda is the eigenvalue (a scalar, possibly complex or repeated). Rearranging gives (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0. A homogeneous system has a nonzero solution only when its coefficient matrix is singular, so eigenvalues are exactly the roots of the characteristic equation

det⁡(A−λI)=0,\det(A-\lambda I)=0,

a degree-nn polynomial in λ\lambda whose nn roots (with multiplicity) are the eigenvalues of AA. For each root λ\lambda, the eigenvectors are the nonzero solutions of (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0; together with 0\mathbf 0 they span the eigenspace Eλ=ker⁡(A−λI)E_\lambda=\ker(A-\lambda I). Every eigenvalue carries two multiplicities that need not agree: its algebraic multiplicity is how many times it repeats as a root of the characteristic polynomial, while its geometric multiplicity is dim⁡Eλ\dim E_\lambda, the number of independent eigenvectors it actually supplies. Always 1≤1\le geometric ≤\le algebraic multiplicity. When every eigenvalue has geometric multiplicity equal to its algebraic multiplicity — guaranteed whenever all nn eigenvalues are distinct, since eigenvectors for distinct eigenvalues are automatically linearly independent — AA has a full set of nn independent eigenvectors and is diagonalizable. Two quick facts turn hand computation into something self-checking rather than a leap of faith: the sum of the eigenvalues equals tr⁡(A)\operatorname{tr}(A), and their product equals det⁡A\det A. A third fact needs no computation at all — for a triangular (or diagonal) matrix, the eigenvalues are simply the diagonal entries, read off directly. A few more facts are worth carrying forward from the earlier topic on special matrices, cited here without re-derivation: eigenvalues of a Hermitian or symmetric matrix are always real, eigenvalues of a unitary or orthogonal matrix always have modulus 11, and eigenvectors of a symmetric or Hermitian matrix corresponding to distinct eigenvalues are automatically orthogonal to each other. It is worth being explicit about why an eigenspace is a genuine subspace rather than just a convenient set: Eλ=ker⁡(A−λI)E_\lambda=\ker(A-\lambda I) is the null space of a linear map, so it automatically contains 0\mathbf 0 and is closed under addition and scalar multiplication — any two eigenvectors sharing the same λ\lambda can be added or scaled and the result is again either an eigenvector for that λ\lambda or the zero vector. This is what lets you speak of a basis for EλE_\lambda and hence of its dimension, the geometric multiplicity, rather than just listing individual eigenvectors one at a time.

Figure
A 2 by 2 grid transformation showing one direction only stretched by the matrix while another direction is rotated away from itself
Eigenvectors are the directions A only stretches generic v Av (rotated) eigenvector v Av = λv (same line) Left: a generic vector is rotated by A. Right: an eigenvector stays on its own line, only scaled.

Derivation

Derivation AThe characteristic equation from the eigenvalue definition

The goal is to show, starting only from the defining relation Av=λvA\mathbf v=\lambda\mathbf v for a nonzero vector v\mathbf v, exactly why eigenvalues must be roots of det⁡(A−λI)=0\det(A-\lambda I)=0, so that the abstract search for "special directions" turns into a concrete polynomial you can solve by hand.

Step 1. Write the defining equation and move everything to one side. Starting from Av=λvA\mathbf v=\lambda\mathbf v, subtract λv\lambda\mathbf v from both sides to get Av−λv=0A\mathbf v-\lambda\mathbf v=\mathbf 0. Since λv=λIv\lambda\mathbf v=\lambda I\mathbf v (inserting the identity matrix changes nothing), this becomes (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0, a single matrix equation in the unknown vector v\mathbf v.

Step 2. Recognize this as a homogeneous linear system. The equation (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0 is exactly the kind of system studied earlier in the course: it always has the trivial solution v=0\mathbf v=\mathbf 0, and it has a nontrivial solution (some v≠0\mathbf v\neq\mathbf 0) if and only if the coefficient matrix A−λIA-\lambda I fails to be invertible, i.e. is singular.

Step 3. Translate singularity into a determinant condition. A square matrix is singular exactly when its determinant is zero, so a nonzero eigenvector for a given λ\lambda exists precisely when det⁡(A−λI)=0\det(A-\lambda I)=0. This is the characteristic equation, and expanding the determinant produces a degree-nn polynomial in λ\lambda — the characteristic polynomial — whose roots are the only candidates for eigenvalues.

Step 4. Close the loop both ways. Any root λ\lambda of det⁡(A−λI)=0\det(A-\lambda I)=0 makes A−λIA-\lambda I singular, which guarantees a nonzero solution v\mathbf v to (A−λI)v=0(A-\lambda I)\mathbf v=\mathbf 0, and any such v\mathbf v satisfies Av=λvA\mathbf v=\lambda\mathbf v by reversing Step 1. So the roots of the characteristic equation are exactly the eigenvalues of AA, with the eigenvectors recovered afterward by solving the homogeneous system for each root in turn.

Worked example

Problem. Find the eigenvalues and eigenvectors of A=(4123)A=\begin{pmatrix}4&1\\2&3\end{pmatrix}, and check whether AA is diagonalizable.

Step 1. Set up the characteristic equation: det⁡(A−λI)=det⁡(4−λ123−λ)=(4−λ)(3−λ)−2=0\det(A-\lambda I)=\det\begin{pmatrix}4-\lambda&1\\2&3-\lambda\end{pmatrix}=(4-\lambda)(3-\lambda)-2=0.

Step 2. Expand and solve: 12−7λ+λ2−2=0⇒λ2−7λ+10=0⇒(λ−5)(λ−2)=012-7\lambda+\lambda^2-2=0\Rightarrow \lambda^2-7\lambda+10=0\Rightarrow(\lambda-5)(\lambda-2)=0, giving λ1=5\lambda_1=5, λ2=2\lambda_2=2. Check: λ1+λ2=7=tr⁡(A)=4+3\lambda_1+\lambda_2=7=\operatorname{tr}(A)=4+3 and λ1λ2=10=det⁡A=12−2\lambda_1\lambda_2=10=\det A=12-2 — both match, so the roots are trustworthy.

Step 3. Find the eigenvector for λ1=5\lambda_1=5 by solving (A−5I)v=0(A-5I)\mathbf v=\mathbf 0: (−112−2)(v1v2)=0\begin{pmatrix}-1&1\\2&-2\end{pmatrix}\begin{pmatrix}v_1\\v_2\end{pmatrix}=\mathbf 0 gives −v1+v2=0-v_1+v_2=0, so v1=v2v_1=v_2 and v1=(1,1)\mathbf v_1=(1,1).

Step 4. Find the eigenvector for λ2=2\lambda_2=2 by solving (A−2I)v=0(A-2I)\mathbf v=\mathbf 0: (2121)(v1v2)=0\begin{pmatrix}2&1\\2&1\end{pmatrix}\begin{pmatrix}v_1\\v_2\end{pmatrix}=\mathbf 0 gives 2v1+v2=02v_1+v_2=0, so v2=(1,−2)\mathbf v_2=(1,-2). Both eigenvalues are distinct (each algebraic and geometric multiplicity 1), and {(1,1),(1,−2)}\{(1,1),(1,-2)\} are linearly independent, so AA has 2 independent eigenvectors and is diagonalizable.

Competitive stretch

For A=(210021003)A=\begin{pmatrix}2&1&0\\0&2&1\\0&0&3\end{pmatrix} (upper triangular), the eigenvalues are the diagonal entries directly: λ=2\lambda=2 with algebraic multiplicity 22, and λ=3\lambda=3 with algebraic multiplicity 11. Solving (A−2I)v=0(A-2I)\mathbf v=\mathbf 0 gives v2=0,v3=0v_2=0,v_3=0 with v1v_1 free, so E2=span⁡{(1,0,0)}E_2=\operatorname{span}\{(1,0,0)\} — only one independent eigenvector, geometric multiplicity 1<21<2. Since geometric multiplicity falls short of algebraic multiplicity for λ=2\lambda=2, this 3×33\times3 matrix has only 22 independent eigenvectors total and is not diagonalizable, even though its eigenvalues were trivial to read off.

Common traps

  • Solving det⁡(A−λI)=0\det(A-\lambda I)=0 correctly, then plugging λ\lambda back into the wrong matrix — always substitute into A−λIA-\lambda I (not AA) when finding each eigenvector, re-solving the homogeneous system separately for every λ\lambda.
  • Assuming geometric multiplicity always equals algebraic multiplicity — the competitive stretch example shows a repeated eigenvalue can have a strictly smaller eigenspace, which is exactly what blocks diagonalizability.
  • Forgetting v≠0\mathbf v\neq\mathbf 0 is part of the definition — the zero vector trivially satisfies A0=λ0A\mathbf 0=\lambda\mathbf 0 for every λ\lambda and is never an eigenvector.
  • Sign or arithmetic slips expanding a 3×33\times3 determinant — always cross-check with tr⁡(A)=∑λi\operatorname{tr}(A)=\sum\lambda_i and det⁡A=∏λi\det A=\prod\lambda_i.

Ask the tutor: want to try a 3×33\times3 matrix with complex eigenvalues, or see step by step how eigenvalues feed into diagonalizing a matrix? Ask the AI tutor to walk through one with you.

Why can't geometric multiplicity ever exceed algebraic multiplicity?

Algebraic multiplicity counts how many times an eigenvalue repeats as a root of the characteristic polynomial, while geometric multiplicity counts independent eigenvectors for that root. If you had more independent eigenvectors than the root's multiplicity, you could build a basis making the characteristic polynomial force a higher multiplicity than it actually has — a contradiction. So geometric multiplicity is always squeezed between 11 and the algebraic multiplicity, never above it.

Do I need to check trace and determinant every time, or only for practice?

Do it every time on an exam. It costs seconds — add the diagonal entries, compare to your ∑λi\sum\lambda_i; multiply the diagonal-derived determinant, compare to ∏λi\prod\lambda_i — and it catches sign errors or arithmetic slips in the characteristic-equation expansion before they cascade into a wrong eigenvector and a wrong final answer.

What happens if the characteristic equation has complex roots?

Complex eigenvalues occur in conjugate pairs for a real matrix, and the eigenvector-finding procedure is identical: substitute the complex λ\lambda into A−λIA-\lambda I and solve the (now complex) homogeneous system. This course's syllabus does allow complex or repeated roots in principle, but the worked problems you'll see stay with real, mostly distinct eigenvalues; the special results for Hermitian and unitary matrices (real eigenvalues, unit-modulus eigenvalues) are cited from the earlier topic, not re-derived here.

Before this

Where this leads