The Spectral Theorem for Self-Adjoint Operators
Which linear operators can be diagonalized using an orthonormal basis? This is one where lengths and angles behave exactly as in Euclidean space. This is not the same question as "which operators are diagonalizable." An arbitrary diagonalizable operator may need a badly-skewed basis. That basis could be full of enormous or nearly-parallel vectors. The Spectral Theorem answers the orthonormal question completely on real inner product spaces. The operators that admit an orthonormal eigenbasis are exactly the self-adjoint ones. This matters because self-adjoint operators are everywhere real geometry and real physics touch linear algebra. Quadratic forms, second derivatives (Hessians), moments of inertia, covariance matrices, and the Hamiltonians of quantum mechanics with real symmetric matrices are all self-adjoint. Understanding them reduces entirely to understanding real numbers — their eigenvalues — sitting on orthogonal axes. The real case is subtler than the complex case treated in The Complex Spectral Theorem. This is because over a matrix need not have any eigenvalues at all: rotations have none. Self-adjointness is precisely the extra structure that rules out rotation-like behavior. It forces real eigenvalues to exist. The big picture is a rigidity phenomenon. On a complex inner product space, the Complex Spectral Theorem shows something important. Normality () is equivalent to the existence of an orthonormal eigenbasis. On a real inner product space, normality is not enough. A rotation matrix is normal but has no real eigenvectors at all. The correct hypothesis strengthens to self-adjointness (). This article proves both directions of the real theorem from scratch. It states the two results side by side as one unified diagonalization statement. It also shows exactly where the extra hypothesis is used. This article delivers a complete, hypothesis-explicit proof of the real Spectral Theorem. It is built on the machinery of Self-Adjoint Operators together with the complex case. We prove existence of at least one real eigenvalue for self-adjoint operators. This is the crux of the real argument. Then we induct using invariant orthogonal complements. We close with worked numerical examples. We also give a counterexample showing why self-adjointness cannot be weakened to normality in the real setting. Finally, we look at where this theorem resurfaces — most immediately in Positive Operators and The Singular Value Decomposition.
- On a finite-dimensional real inner product space, has an orthonormal eigenbasis iff is self-adjoint ().
- On a finite-dimensional complex inner product space, has an orthonormal eigenbasis iff is normal (); self-adjoint operators are a special case with real eigenvalues.
- The hard direction in is existence: a self-adjoint operator on a nonzero real space must have a real eigenvalue — this fails for general normal real operators (rotations).
- Proof strategy: find one eigenvalue (via the complexification/quadratic-form argument), split off its eigenvector, restrict to the orthogonal complement, and induct — an orthogonal-complement induction.
- In matrix language: real symmetric for some orthogonal and real diagonal ; complex Hermitian or normal for unitary .
- Key idea: self-adjointness is exactly the algebraic condition that converts the geometric wish "diagonalize with an orthonormal basis" into the guaranteed existence of real eigenvalues and orthogonal eigenspaces.
Where this lives today
Quadratic forms and optimization. Every quadratic form with symmetric is diagonalized by the Spectral Theorem into in the rotated coordinates ; the signs of the classify as positive definite, indefinite, etc., which is the entire content of the second-derivative test in multivariable calculus (the Hessian is symmetric) and underlies convex optimization.
Principal Component Analysis and statistics. The covariance matrix of a data set is symmetric positive semidefinite; its orthonormal eigenbasis (principal components) gives the directions of maximal variance, ordered by eigenvalue, foundational to dimensionality reduction and data compression.
Physics. Moments of inertia are encoded by a real symmetric tensor whose orthonormal eigenbasis gives the principal axes of rotation of a rigid body; in quantum mechanics, physical observables are modeled by self-adjoint (Hermitian) operators precisely because the Spectral Theorem guarantees real eigenvalues (measurement outcomes) and an orthonormal eigenbasis (measurement collapse states).
Graph theory and spectral graph theory. The Laplacian matrix of a graph is real symmetric (as seen in Example 1's Laplacian); its eigenvalues and orthonormal eigenvectors encode connectivity, expansion, and clustering structure, central to spectral clustering algorithms.
Numerical linear algebra. Algorithms such as the QR algorithm and Jacobi eigenvalue algorithm exploit symmetry to compute eigendecompositions stably and efficiently, since orthogonal similarity transformations preserve conditioning far better than general similarity transformations.
Onward. The theorem is the direct ancestor of Positive Operators (self-adjoint operators with nonnegative eigenvalues, characterizing ) and The Singular Value Decomposition (applying the Spectral Theorem to the self-adjoint, positive semidefinite operator for an arbitrary — not necessarily self-adjoint — operator , to produce singular values and singular vector bases).
Ask the tutor: Can you show me how applying this theorem to for a non-self-adjoint leads directly to the singular value decomposition?
Let be a finite-dimensional inner product space over (where or ), and let be a linear operator on .
Adjoint. The adjoint of is the unique operator satisfying
(Existence and uniqueness of is standard and assumed from Self-Adjoint Operators.)
Self-adjoint. is self-adjoint if , i.e. for all . In matrix terms with respect to an orthonormal basis, this means the matrix of equals its conjugate transpose: (Hermitian when ; symmetric, , when ).
Normal. is normal if . Every self-adjoint operator is normal (since trivially commutes with itself), but on real spaces the converse fails.
Orthonormal eigenbasis. admits an orthonormal eigenbasis if there is a basis of that is orthonormal () and consists of eigenvectors of , i.e. for scalars .
Intuition
Think of a self-adjoint operator as a machine that stretches space along a family of mutually perpendicular directions, with no rotation, shear, or complex twisting mixed in. The symmetric-matrix condition is exactly what prevents "off-diagonal antisymmetric" behavior — the part of a matrix that generates rotation. Decompose any real square matrix as , its symmetric and antisymmetric parts; the antisymmetric part is responsible for rotation-like eigenvalue-free behavior (think of , a quarter turn with no real eigenvectors). Requiring to be symmetric () removes this obstruction entirely, and the theorem says that is exactly enough to guarantee real eigenvalues and orthogonal eigenspaces. Geometrically, a self-adjoint operator on sends the unit sphere to an ellipsoid whose axes are orthogonal and whose axis lengths are — this is the picture behind quadratic forms, principal axes of inertia, and (later) singular values. The proof strategy mirrors this picture: find one axis (an eigenvector), note the operator preserves the hyperplane orthogonal to it, and repeat inside that smaller space.
Let be a nonzero finite-dimensional inner product space over , and let .
(Complex case, , cited from <a class="wiki-link" href="/wiki/math-linalg-complex-spectral-theorem" data-track="wiki_article.body.wiki_link">The Complex Spectral Theorem</a>). has an orthonormal basis consisting of eigenvectors of if and only if is normal, i.e. .
(Real case, ). has an orthonormal basis consisting of eigenvectors of if and only if is self-adjoint, i.e. . Equivalently, in matrix form: a real matrix is orthogonally diagonalizable (, orthogonal, real diagonal) if and only if is symmetric; a complex matrix is unitarily diagonalizable (, unitary, diagonal) if and only if is normal.
We prove the real case in full; the complex case is assumed as a prerequisite result, but we will use one direction of its proof technique (the "peel off an eigenvector, restrict to orthogonal complement" induction) explicitly, adapting it to the real setting where the existence of even one eigenvalue must be earned.
Let be a finite-dimensional real inner product space and let be self-adjoint. Then has at least one eigenvalue, and every eigenvalue of is real (the latter is automatic in , but the content is existence).
Technique: variational/quadratic-form argument for existence, reduction to the complex case for the "no complex eigenvalues" bookkeeping. Let . Fix an orthonormal basis of and let be the matrix of in this basis; since , the matrix satisfies (real symmetric). Step 1: , viewed as a complex matrix, is Hermitian, hence has real eigenvalues (with multiplicity). View as an operator on with the standard Hermitian inner product. Since is real symmetric, , so is Hermitian as a complex matrix, in particular normal. By the Complex Spectral Theorem, (acting on ) has an orthonormal eigenbasis with , . We claim each . Indeed, for any eigenpair with in ,
using and sesquilinearity ( in the convention linear in the first slot). Since , we get , so . Step 2: at least one such yields a genuine real eigenvector for on . We now must produce an actual eigenvector inside the real space , not merely in . Take any eigenvalue of found in Step 1 (there is at least one since ), with complex eigenvector , , . Since is a real matrix and is real,
Comparing real and imaginary parts (both and are real, so this is valid termwise):
Since , at least one of is a nonzero real vector. That vector, call it , satisfies with . Thus is a genuine real eigenvalue of acting on , i.e. of acting on , and (identified with the corresponding vector in via the fixed orthonormal basis) is a real eigenvector. This proves has at least one (real) eigenvalue, completing the lemma.
∎Proof of the Spectral Theorem, real case. Technique: induction on , using invariant orthogonal complements — the same architecture used in the complex case, with the Lemma supplying the needed existence step.
() Self-adjoint orthonormal eigenbasis exists. We induct on . Base case . Any nonzero vector, normalized, is an orthonormal eigenbasis trivially (every operator on a -dimensional space is a scalar multiple of the identity). Inductive step. Suppose and the result holds for all self-adjoint operators on real inner product spaces of dimension less than . Let be self-adjoint with . By the Lemma, has a real eigenvalue with a nonzero eigenvector ; let , so and . Let be the orthogonal complement of . We know (standard orthogonal complement dimension count in a finite-dimensional inner product space) and . Claim: is invariant under , i.e. . Let , so . Then
using self-adjointness () in the first equality. Hence , proving the claim. Claim: , the restriction of to , is a self-adjoint operator on . First, is a well-defined operator on by the invariance just shown. For ,
where the middle equality is self-adjointness of on , and the inner product on is simply the restriction of the inner product on . This shows satisfies the defining property of self-adjointness with respect to the inner product on . Since , the inductive hypothesis applies to on : there is an orthonormal basis of consisting of eigenvectors of , hence of (as agrees with on ). Now consider . Each () lies in , hence is orthogonal to by definition of ; the for are mutually orthonormal by construction; and . So is an orthonormal set of vectors in the -dimensional space , hence an orthonormal basis (an orthonormal set is automatically linearly independent: if , taking the inner product with gives for each ; a linearly independent set of size is a basis). Each is an eigenvector of : by construction, and by the inductive hypothesis applied to on . This completes the induction, proving that self-adjoint admits an orthonormal eigenbasis.
() Orthonormal eigenbasis exists is self-adjoint. Suppose is an orthonormal basis of with , . We must show for all ; by bilinearity it suffices to check this on basis vectors , . We compute both sides:
Since are real, when both sides equal ; when both sides equal . In either case . By bilinearity this extends to all , so for all , which is exactly the statement , i.e. is self-adjoint. Both directions are established, completing the proof of the real Spectral Theorem. The complex statement is The Complex Spectral Theorem, assumed as a prerequisite and invoked only in Step 1 of the Lemma above (to extract real eigenvalues), not in a circular way, since that invocation concerns the complex vector space and its independently-established theory.
∎Let be self-adjoint on a real inner product space , with distinct eigenvalues . Then eigenvectors for distinct eigenvalues are orthogonal: if and with , then . Consequently is an orthogonal direct sum of eigenspaces, and in matrix form where is orthogonal (its columns are the orthonormal eigenbasis) and (with repetitions according to multiplicity).
Using self-adjointness,
so ; since , we conclude . For the matrix statement: let be the orthonormal eigenbasis from the theorem, the matrix with these as columns. Orthonormality of the columns means , i.e. is orthogonal (). Since , we have where , so .
∎Worked examples
Example 1: A real symmetric matrix with an asymmetric spread of eigenvalues. Let
This is symmetric (), so the theorem guarantees an orthogonal diagonalization. Compute the characteristic polynomial. Note where is the all-ones matrix. The matrix has eigenvalues (eigenvector ) and (multiplicity , on the plane orthogonal to , since has rank and trace ). Hence has eigenvalues
Check directly: . ✓. For the eigenspace of : solve , i.e.
a -dimensional space, namely , exactly as predicted by the Corollary (eigenvectors for and must be orthogonal, and indeed ). An orthonormal basis of : take and (obtained via Gram–Schmidt on and ). One checks . Together with , the matrix
is orthogonal, and , exactly as the Corollary predicts. This matrix is in fact the graph Laplacian of the triangle graph — a first hint of where symmetric matrices arise combinatorially.
Example 2: A non-symmetric self-adjoint check and explicit failure diagnosis. Let
Here (), so is not self-adjoint (w.r.t. the standard inner product) and the theorem does not apply directly — but it is instructive to see the diagonalization exist over anyway (since ) while failing to be orthogonal. Eigenvalues: . For : solve :
checking . ✓ For : similarly up to scale, checking . ✓ Now test orthogonality: . The eigenvectors are not orthogonal, exactly as expected since is diagonalizable over (real eigenvalues exist here by luck of the discriminant) but is not self-adjoint, so the Corollary's orthogonality conclusion need not — and does not — hold. This shows the theorem's hypothesis is doing real work even when eigenvalues happen to be real: self-adjointness is what forces orthogonality of eigenvectors, not merely diagonalizability.
Consider the rotation matrix
representing counterclockwise rotation by , with the standard inner product on .
is normal. We compute . Then
So ; is normal (in fact orthogonal).
is not self-adjoint. since .
has no real eigenvalues, hence no real eigenvectors, hence no orthonormal eigenbasis of . The characteristic polynomial is , whose roots are not real. Geometrically, rotates every nonzero vector by , so is never a real scalar multiple of for : no line through the origin is preserved. This shows that on a real inner product space, normality alone (the hypothesis that suffices in the complex Spectral Theorem) is not enough to guarantee an orthonormal eigenbasis — the conclusion of the theorem genuinely fails. The extra strength of self-adjointness (, not merely ) is exactly what the Lemma used to force a real eigenvalue to exist in the first place; dropping it collapses the proof at Step 2 of the Lemma, where the real matrix , viewed over , does have eigenvalues , but these are non-real, so the "compare real and imaginary parts" argument produces no real eigenvector at all.
Scope, edge cases & common traps
| Situation | What happens | Why |
|---|---|---|
| , self-adjoint | Orthonormal eigenbasis exists, all eigenvalues real | Full theorem applies |
| , normal but not self-adjoint | May have no real eigenvalues at all | Rotation counterexample above |
| , normal (includes self-adjoint, unitary, skew-Hermitian) | Orthonormal eigenbasis exists | The Complex Spectral Theorem |
| , self-adjoint (Hermitian) | Orthonormal eigenbasis exists and all eigenvalues real | Special case of complex theorem plus the real-eigenvalue computation in Step 1 of the Lemma |
| diagonalizable but eigenvectors not orthogonal | Diagonalizable orthogonally diagonalizable | Example 2 above: real eigenvalues existed but eigenvectors were skew |
| Statement is vacuous | No content; excluded by "nonzero" hypothesis for cleanliness |
The mathematician behind it
Origins · 1 minAugustin-Louis Cauchy and how this was discovered
Cauchy is best known for founding rigorous analysis — the epsilon-delta definitions of limits, continuity, and convergence that underlie the entire discipline — but his work on quadratic forms and what we would now call symmetric matrices, developed in the study of the principal axes of surfaces defined by quadratic equations (conics and quadrics), anticipates the real Spectral Theorem in geometric form. Cauchy proved, in effect, that quadratic forms in several variables can be brought to a sum-of-squares diagonal form by an orthogonal change of coordinates, work motivated by celestial mechanics and the theory of elasticity, where symmetric matrices arise as moment-of-inertia tensors and stress tensors. The abstract operator formulation used today, with inner product spaces and adjoints, was assembled later by Hilbert, Schmidt, and others extending these ideas to infinite dimensions, but the finite-dimensional real symmetric case traces its geometric heart to Cauchy's principal axis theorem.
Why does the complex Spectral Theorem only need "normal" while the real one needs "self-adjoint"?
Normality () is the correct necessary-and-sufficient condition for a unitary diagonalization whenever the field is algebraically closed, because over every operator has a full set of eigenvalues (with multiplicity), and normality is exactly what makes the corresponding generalized eigenvectors resolve into genuine orthogonal eigenvectors. Over , the field is not algebraically closed, so an operator may have no real eigenvalues at all (e.g., a rotation). Self-adjointness is strictly stronger than normality on a real space, and it is precisely strong enough to force the existence of a real eigenvalue in the first place, which is the missing ingredient normality alone cannot supply.
Is every symmetric matrix diagonalizable, and is that the same as this theorem?
Every real symmetric matrix is diagonalizable — this is implied by the Spectral Theorem, since an orthonormal eigenbasis is in particular a basis of eigenvectors. But the Spectral Theorem asserts strictly more: not just that a full eigenbasis exists, but that it can be chosen orthonormal. There exist non-symmetric real matrices that are diagonalizable (Example 2's has distinct real eigenvalues, hence is diagonalizable) but whose eigenvectors are not orthogonal. Diagonalizability is a weaker, more common property; orthogonal diagonalizability is special to self-adjoint operators.
Does the theorem require finite dimension?
Yes, as stated here. The proof relies on dimension induction and on the existence of a characteristic polynomial with finitely many roots, both finite-dimensional notions. Infinite-dimensional generalizations exist (spectral theory of self-adjoint operators on Hilbert spaces), but they require substantially more machinery — spectral measures rather than finite eigenbases — and are a separate, more advanced theory built by Hilbert, von Neumann, and others, not a direct corollary of the finite-dimensional statement.
How does this theorem relate to quadratic forms and the second derivative test?
A quadratic form with symmetric corresponds bijectively to a self-adjoint operator. The Spectral Theorem diagonalizes via an orthogonal change of variables , turning into . The signs of the determine whether is positive definite, negative definite, or indefinite, which is exactly the content of the second-derivative (Hessian) test for local extrema in multivariable calculus, since the Hessian of a smooth function is always symmetric by equality of mixed partials.
What goes wrong in the proof if we only assume is diagonalizable, not self-adjoint?
The induction step in the proof crucially uses self-adjointness twice: once to guarantee an eigenvalue exists at all (via the Lemma, which needs for the reality argument), and again to show the orthogonal complement of an eigenvector is -invariant, which used . If is merely diagonalizable without being self-adjoint, the eigenspaces need not be mutually orthogonal (Example 2), so the orthogonal complement of one eigenvector is not guaranteed to be invariant, and the induction cannot proceed.
Why is the complexification trick in the Lemma not circular, given the theorem is about real spaces?
The Lemma invokes the Complex Spectral Theorem applied to the matrix reinterpreted as acting on with the standard Hermitian inner product — a genuinely different, independently established result about complex normal operators. Nothing about the real Spectral Theorem is assumed in that invocation; it is a one-directional import of a prerequisite fact, used only to extract candidate eigenvalues, after which the argument returns entirely to real linear algebra (comparing real and imaginary parts) to build the real eigenvector. This is a legitimate, non-circular reduction.
Does the theorem say anything about the eigenvalues' signs or magnitudes?
Not directly — the theorem guarantees the eigenvalues are real and the eigenbasis is orthonormal, but says nothing about their sign or size in general. Refinements exist: a self-adjoint operator is called positive semidefinite if all eigenvalues are (equivalently for all ), which is the subject of Positive Operators, and this refinement is exactly what powers constructions like matrix square roots and the Singular Value Decomposition via .