Eigenvalues and eigenvectors
Multiply almost any vector by a square matrix and it gets rotated as well as stretched — its direction changes unpredictably. A handful of special directions escape this fate: multiplying by merely stretches or shrinks them, never rotates them. These directions are the eigenvectors of , and the stretch factor along each one is its eigenvalue. This single pair is the organizing idea behind diagonalization, matrix powers, stability analysis, and much of the applied mathematics you will meet after this course. It builds directly on the matrix algebra (determinants, rank) and linear-transformation results from earlier in the unit, and it sets up everything that follows in vector spaces and eigenvalue problems. Numerical algorithms for finding eigenvalues (power method, QR iteration) are out of scope here — only the algebraic characteristic-equation approach is used.
An eigenvector of is a nonzero direction that only stretches by a factor (its eigenvalue), found by solving and then the homogeneous system .
The core idea
A nonzero vector is an eigenvector of a square matrix () with eigenvalue if multiplying by reproduces scaled by :
where: is the matrix, is the eigenvector (a nonzero column vector), and is the eigenvalue (a scalar, possibly complex or repeated). Rearranging gives . A homogeneous system has a nonzero solution only when its coefficient matrix is singular, so eigenvalues are exactly the roots of the characteristic equation
a degree- polynomial in whose roots (with multiplicity) are the eigenvalues of . For each root , the eigenvectors are the nonzero solutions of ; together with they span the eigenspace . Every eigenvalue carries two multiplicities that need not agree: its algebraic multiplicity is how many times it repeats as a root of the characteristic polynomial, while its geometric multiplicity is , the number of independent eigenvectors it actually supplies. Always geometric algebraic multiplicity. When every eigenvalue has geometric multiplicity equal to its algebraic multiplicity — guaranteed whenever all eigenvalues are distinct, since eigenvectors for distinct eigenvalues are automatically linearly independent — has a full set of independent eigenvectors and is diagonalizable. Two quick facts turn hand computation into something self-checking rather than a leap of faith: the sum of the eigenvalues equals , and their product equals . A third fact needs no computation at all — for a triangular (or diagonal) matrix, the eigenvalues are simply the diagonal entries, read off directly. A few more facts are worth carrying forward from the earlier topic on special matrices, cited here without re-derivation: eigenvalues of a Hermitian or symmetric matrix are always real, eigenvalues of a unitary or orthogonal matrix always have modulus , and eigenvectors of a symmetric or Hermitian matrix corresponding to distinct eigenvalues are automatically orthogonal to each other. It is worth being explicit about why an eigenspace is a genuine subspace rather than just a convenient set: is the null space of a linear map, so it automatically contains and is closed under addition and scalar multiplication — any two eigenvectors sharing the same can be added or scaled and the result is again either an eigenvector for that or the zero vector. This is what lets you speak of a basis for and hence of its dimension, the geometric multiplicity, rather than just listing individual eigenvectors one at a time.
Derivation
The goal is to show, starting only from the defining relation for a nonzero vector , exactly why eigenvalues must be roots of , so that the abstract search for "special directions" turns into a concrete polynomial you can solve by hand.
Step 1. Write the defining equation and move everything to one side. Starting from , subtract from both sides to get . Since (inserting the identity matrix changes nothing), this becomes , a single matrix equation in the unknown vector .
Step 2. Recognize this as a homogeneous linear system. The equation is exactly the kind of system studied earlier in the course: it always has the trivial solution , and it has a nontrivial solution (some ) if and only if the coefficient matrix fails to be invertible, i.e. is singular.
Step 3. Translate singularity into a determinant condition. A square matrix is singular exactly when its determinant is zero, so a nonzero eigenvector for a given exists precisely when . This is the characteristic equation, and expanding the determinant produces a degree- polynomial in — the characteristic polynomial — whose roots are the only candidates for eigenvalues.
Step 4. Close the loop both ways. Any root of makes singular, which guarantees a nonzero solution to , and any such satisfies by reversing Step 1. So the roots of the characteristic equation are exactly the eigenvalues of , with the eigenvectors recovered afterward by solving the homogeneous system for each root in turn.
Worked example
Problem. Find the eigenvalues and eigenvectors of , and check whether is diagonalizable.
Step 1. Set up the characteristic equation: .
Step 2. Expand and solve: , giving , . Check: and — both match, so the roots are trustworthy.
Step 3. Find the eigenvector for by solving : gives , so and .
Step 4. Find the eigenvector for by solving : gives , so . Both eigenvalues are distinct (each algebraic and geometric multiplicity 1), and are linearly independent, so has 2 independent eigenvectors and is diagonalizable.
Competitive stretch
For (upper triangular), the eigenvalues are the diagonal entries directly: with algebraic multiplicity , and with algebraic multiplicity . Solving gives with free, so — only one independent eigenvector, geometric multiplicity . Since geometric multiplicity falls short of algebraic multiplicity for , this matrix has only independent eigenvectors total and is not diagonalizable, even though its eigenvalues were trivial to read off.
Common traps
- Solving correctly, then plugging back into the wrong matrix — always substitute into (not ) when finding each eigenvector, re-solving the homogeneous system separately for every .
- Assuming geometric multiplicity always equals algebraic multiplicity — the competitive stretch example shows a repeated eigenvalue can have a strictly smaller eigenspace, which is exactly what blocks diagonalizability.
- Forgetting is part of the definition — the zero vector trivially satisfies for every and is never an eigenvector.
- Sign or arithmetic slips expanding a determinant — always cross-check with and .
Ask the tutor: want to try a matrix with complex eigenvalues, or see step by step how eigenvalues feed into diagonalizing a matrix? Ask the AI tutor to walk through one with you.
Why can't geometric multiplicity ever exceed algebraic multiplicity?
Algebraic multiplicity counts how many times an eigenvalue repeats as a root of the characteristic polynomial, while geometric multiplicity counts independent eigenvectors for that root. If you had more independent eigenvectors than the root's multiplicity, you could build a basis making the characteristic polynomial force a higher multiplicity than it actually has — a contradiction. So geometric multiplicity is always squeezed between and the algebraic multiplicity, never above it.
Do I need to check trace and determinant every time, or only for practice?
Do it every time on an exam. It costs seconds — add the diagonal entries, compare to your ; multiply the diagonal-derived determinant, compare to — and it catches sign errors or arithmetic slips in the characteristic-equation expansion before they cascade into a wrong eigenvector and a wrong final answer.
What happens if the characteristic equation has complex roots?
Complex eigenvalues occur in conjugate pairs for a real matrix, and the eigenvector-finding procedure is identical: substitute the complex into and solve the (now complex) homogeneous system. This course's syllabus does allow complex or repeated roots in principle, but the worked problems you'll see stay with real, mostly distinct eigenvalues; the special results for Hermitian and unitary matrices (real eigenvalues, unit-modulus eigenvalues) are cited from the earlier topic, not re-derived here.