Normal Operators
When can an operator be diagonalized by an orthonormal basis? This single question drives a large part of the theory of Inner Product Spaces. The answer turns out to hinge on a deceptively simple algebraic condition: commuting with your own adjoint. An operator on a finite-dimensional inner product space is called normal if . Self-adjoint operators () are the most familiar examples. But normality is a strictly larger and more flexible class. It encompasses unitary operators, skew-adjoint operators, and rotations in the plane. The importance of normality is that it is exactly the right hypothesis. It makes an operator behave well with respect to lengths and eigenvectors. It does this without forcing the operator to have only real eigenvalues. Normal operators satisfy the striking identity for every vector . This single fact cascades into a rich structure theory. Eigenvectors of for distinct eigenvalues are automatically orthogonal. Every eigenvector of is simultaneously an eigenvector of with the conjugate eigenvalue. These facts are the load-bearing walls on which the Complex Spectral Theorem is built. The big picture is this: Self-Adjoint Operators are the "real numbers" of operator theory. They have real eigenvalues and orthonormal eigenbases. Normal operators are the "complex numbers" of operator theory. Over , they also have orthonormal eigenbases. But their eigenvalues can be any complex numbers. This article isolates the precise commuting condition. It proves the norm-preservation identity that powers everything else. It also establishes the orthogonality-of-eigenspaces and shared-eigenvector results. These results are the direct stepping stones to the spectral theorem. This article delivers a complete, self-contained treatment: the formal definition, geometric intuition with figures, a fully proved central theorem with all its algebraic consequences, two asymmetric worked examples, a counterexample showing why the base field matters, and a map of where normality shows up across mathematics, physics, and computation.
- A normal operator satisfies ; this is a commutativity condition, not a symmetry condition.
- Normality is exactly the condition equivalent to for all vectors .
- Self-adjoint, skew-adjoint, unitary, and orthogonal operators are all normal, but normal operators need not be any of these.
- Eigenvectors of a normal operator for distinct eigenvalues are automatically orthogonal.
- If then : and share eigenvectors with conjugated eigenvalues.
- Key idea: commuting with the adjoint is precisely what makes an operator's action on lengths and eigenvectors mirror that of its adjoint.
Where this lives today
Normal operators are the natural habitat of the Complex Spectral Theorem, which states that on a finite-dimensional complex inner product space is normal if and only if has an orthonormal basis of eigenvectors of — the orthogonality proved here in part (d) is exactly the ingredient that makes such a basis orthonormal rather than merely a basis. In quantum mechanics, physical observables are represented by self-adjoint operators, but the broader class of normal operators governs the algebra of compatible observables and appears in the study of unitary time-evolution operators, which are normal but not self-adjoint. In numerical linear algebra, normal matrices are exactly the matrices diagonalizable by a unitary similarity, which is the theoretical basis for why algorithms like the symmetric/Hermitian QR algorithm and its normal-matrix generalizations converge so robustly, in contrast to general non-normal matrices where eigenvalue computations can be numerically unstable (the condition number of the eigenvector matrix blows up precisely when normality fails). In signal processing, circulant matrices (which represent convolution operators) are always normal, diagonalized by the discrete Fourier transform matrix — this is the linear-algebraic heart of the Fast Fourier Transform's spectral interpretation. In statistics, normal operators appear via covariance and correlation operators in multivariate analysis, and orthogonality of eigenspaces underlies the validity of principal component analysis. In cryptography and coding theory, normal matrices over finite fields and their spectral properties inform the design of linear codes with good distance properties.
Ask the tutor: Why does the Complex Spectral Theorem require normality exactly, and what fails in the proof of orthonormal diagonalizability if merely has distinct eigenvalues but is not normal?
Let be a finite-dimensional inner product space over (where or ), and let be a linear operator on . Recall from The Adjoint of a Linear Map that the adjoint is the unique operator satisfying
The operator is called normal if
i.e., commutes with its own adjoint. Equivalently, for every .
Intuition
Think of as a kind of "mirror image" of dictated entirely by the inner product. For a self-adjoint operator, the mirror image is the operator itself: . Normality is a weaker demand — it does not require to equal its mirror image, only that and its mirror image commute as transformations. Commuting operators share a great deal of structure (for instance, they often share eigenvectors), and this is exactly what happens here: and , while generally different operators, act compatibly enough that they share every eigenvector. A good mental picture is a rotation in the plane. A rotation by angle is not self-adjoint (its matrix is not symmetric unless is a multiple of ), yet it is normal: rotating and then reflecting (which is what the adjoint of a rotation matrix does, since rotations are orthogonal and ) commutes with rotating first and then applying that same inverse. The key geometric fact that makes rotations "nice" despite not being self-adjoint is that a rotation never changes lengths — and neither does its adjoint. This length-preservation-of-both--and- phenomenon is the heart of the theorem below: normality is equivalent to the statement for every .
Core theorem and its consequences
Let be a finite-dimensional inner product space over ( or ), and let .
(a) Norm equality. is normal if and only if
(b) Kernels agree. If is normal, then .
(c) Eigenvector transfer. If is normal and , satisfy , then
That is, every eigenvector of with eigenvalue is an eigenvector of with eigenvalue .
(d) Orthogonality of eigenspaces. If is normal and are distinct eigenvalues of with eigenvectors respectively, then .
We prove each part in order; part (a) is the foundation for (b)–(d), and it is proved with no circularity, using only the definition of adjoint and basic inner product axioms.
Proof of (a). For any and any , by definition of the adjoint,
Apply this identity twice, once with and once with (using , a standard property of adjoints established alongside the definition of the adjoint):
Subtracting,
() Suppose is normal, so . Then the right side of is for every , so for every , hence (norms are nonnegative). () Suppose for all . Define . This operator is self-adjoint: indeed,
using and . By hypothesis and , for every . We now invoke the standard fact (proved for self-adjoint operators, and valid over both and given the self-adjointness of , using polarization) that a self-adjoint operator satisfying for all must be the zero operator. We reprove this here directly to keep the argument self-contained. Since for all , replace by for arbitrary :
The first and last terms vanish by hypothesis (applied to and to ), leaving
Since is self-adjoint, . Substituting into :
So for all . If , this already says for all ; taking gives so for every , i.e. . If , replace by in the same identity: . Since , and for , we get as well. Combined with , this forces for all ; taking again gives . Either way, , i.e. , so is normal. This proves (a).
Proof of (b). By part (a) with : , so , i.e. . This shows . Applying the same argument with replaced by — note is also normal, since — gives . Hence .
Proof of (c). Suppose . Consider the operator . We claim is normal: its adjoint is (adjoint of a scalar multiple conjugates the scalar, a basic property of adjoints), and
Since is normal, , so these two expressions are equal; thus is normal. Now apply part (a) to the normal operator and the vector :
The left side is since . Hence the right side is also :
Proof of (d). Let and with . By part (c) applied to (eigenvalue ), we have . Compute two ways using the defining property of the adjoint:
where the last step uses conjugate-linearity of the inner product in the second slot: . Equating the two expressions:
Since , we conclude , i.e. .
∎If is self-adjoint (), then trivially , so is normal. If in addition for , part (c) gives , but , so , forcing (as ), i.e. . This recovers the familiar fact that Self-Adjoint Operators have real eigenvalues, as a special case of normality.
Worked examples
Example 1 — a genuinely non-self-adjoint normal operator, with an asymmetric matrix. Let with the standard inner product, and let be given in the standard basis by
We verify normality directly and then locate the eigenvector-sharing predicted by part (c). The adjoint (conjugate transpose) is
Compute :
Since , the diagonal entries are both . The off-diagonal entries: and . So
Now compute :
Again , diagonal entries . Off-diagonal: and . So
Thus is normal. Note (compare the entries: versus ), so is not self-adjoint, confirming that normality is a strictly weaker condition. Now find the eigenvalues. The characteristic polynomial is
Set , so . This gives or . So the eigenvalues are and , matching the corollary's prediction of complex (non-real) eigenvalues for a non-self-adjoint operator. For : solve :
Take . For : solve :
Take .
Check orthogonality (part (d)): ✓, confirming eigenspaces for distinct eigenvalues are orthogonal, exactly as guaranteed since is normal.
Check eigenvector transfer (part (c)): we predict . Compute directly:
Indeed , confirming part (c) numerically.
Example 2 — using the norm identity to prove normality fails, with an asymmetric real matrix. Let on (standard inner product) have matrix
Is normal? By part (a), it suffices to find one vector with . We have . Take . Then
Since , part (a) tells us is not normal — without ever computing or directly, though for confirmation:
and indeed . This example illustrates the practical power of part (a): a single failed norm comparison certifies non-normality without a full matrix multiplication, and it shows that a generic (asymmetric, real, non-orthogonal) matrix is normal only under real algebraic constraints — here the off-diagonal asymmetry ( versus ) is exactly what breaks the commuting condition.
The proof of part (a) used conjugate-linearity of the inner product in one slot in an essential way (specifically, in isolating both real and imaginary parts to force over ). One might ask: is the converse-style implication in part (a) — "norm equality forces normality" — perhaps not needed at all, and could we instead try to get eigenvector-orthogonality (part (d)) from a weaker hypothesis than full normality, such as merely having an orthogonal eigenbasis to begin with, assumed rather than derived? Here is why the normality hypothesis itself cannot be dropped from parts (c) and (d): consider and the operator with matrix
which is not normal (a direct computation, as in Example 2's style, shows : with ,
and these disagree, e.g. in the entry: ). The eigenvalues of are (eigenvector ) and (eigenvector: solve , i.e. , giving ). Check orthogonality: . So and , eigenvectors for the distinct eigenvalues , are not orthogonal — part (d) fails completely once normality is dropped. Likewise, part (c) fails: , which is not a scalar multiple of at all (let alone ), so does not even share this eigenvector, never mind with the conjugated eigenvalue. This shows the normality hypothesis in the theorem is not a technical convenience — it is exactly the condition without which both conclusions (c) and (d) can fail outright.
Scope, edge cases & common traps
| Situation | Status | Note |
|---|---|---|
| self-adjoint | Normal | Special case: commutes with itself trivially |
| unitary/orthogonal | Normal | |
| skew-adjoint () | Normal | |
| nilpotent, | Generally not normal | e.g. fails norm test |
| Infinite-dimensional | Definition extends, but proof of (a) needs care | Requires bounded operators, adjoint existence assumed |
| , normal | Eigenvalues may be non-real as roots of char. poly, but may have no real eigenvectors | Real spectral theory needs orthogonal block structure instead |
| Distinct eigenvalues assumed in (d) | Required | Equal eigenvalues give no orthogonality constraint from this argument |
The mathematician behind it
Origins · 1 minDavid Hilbert and how this was discovered
Hilbert's work on integral equations and quadratic forms in infinitely many variables, developed in the first decade of the 1900s, laid the groundwork for the abstract theory of what are now called Hilbert spaces. The classification of operators by their relationship to their adjoints — self-adjoint, normal, unitary — emerged from this tradition as mathematicians and physicists (notably John von Neumann, working to formalize quantum mechanics) sought the right algebraic conditions under which an operator admits a complete orthogonal eigenbasis or an analogous spectral decomposition.
Is every normal operator diagonalizable?
Over , yes: this is precisely the content of the Complex Spectral Theorem, which builds directly on the results proved here (orthogonality of eigenspaces for distinct eigenvalues, and the shared-eigenvector fact) to show a normal operator has an orthonormal basis of eigenvectors. Over , the situation is more subtle: a normal real operator need not be diagonalizable over the reals (a rotation by a nonzero, non- angle is normal but has no real eigenvectors at all), though it does admit a block-diagonal decomposition into blocks and rotation-scaling blocks. This article establishes the algebraic core; the diagonalization statement itself is the spectral theorem, treated separately.
Why is the condition called "normal" — is there a geometric meaning to the word?
The terminology is largely historical, tracing to the German "normal" in the sense of "standard" or "canonical form," reflecting the fact that these are exactly the operators reducible to a canonical (diagonal, in the complex case) form via an orthonormal change of basis. There is no direct connection to "normal vectors" in the sense of perpendicularity, although the eigenvectors of a normal operator do end up mutually orthogonal (part (d)) — a coincidence of terminology that is worth noting but is not the origin of the name.
Does need to be checked on a basis, or does it really need to hold on every vector?
Since and are both linear operators, they are equal as operators if and only if they agree on every vector of any one basis (spanning set), by linearity. So in practice, checking for each vector in a basis is sufficient, or equivalently (and usually easiest) simply multiplying the matrices and in some orthonormal basis and comparing the two resulting matrices entrywise, as done in the worked examples.
Is the sum or product of two normal operators always normal?
No, in general neither is normal — this is a common trap. The product of two normal operators need not be normal unless and commute with each other; even the sum need not be normal without further hypotheses. However, if and are both normal and commute with each other and with each other's adjoints in the right combination, more can be said, but the general statement requires care and is not automatic from normality of the individual factors alone.
How does normality relate to self-adjointness and unitarity — is there a Venn diagram?
Yes: self-adjoint operators and unitary (orthogonal) operators are both special cases of normal operators, but they are generally disjoint classes from each other outside trivial overlaps (an operator that is both self-adjoint and unitary must satisfy with , so it is an orthogonal projection reflection, i.e. ). Normal operators form the larger umbrella class: is normal iff it commutes with , a strictly weaker condition than (self-adjoint) or (unitary), each of which forces commuting with trivially but not conversely.
Why does the proof of part (a) need the self-adjointness of , rather than working with directly?
The trick of reducing " for all implies " to a clean polarization argument genuinely requires to be self-adjoint (or at least normal) — otherwise the identity used in the proof would fail, since that step used explicitly. Fortunately, is automatically self-adjoint for any operator whatsoever (as shown directly in the proof), which is precisely why this auxiliary operator, rather than itself, is the right object to apply the "zero quadratic form implies zero operator" lemma to.
Can normality be checked just by looking at a matrix's entries, without computing two matrix products?
There is a useful necessary condition: the sum of squared absolute values of all matrix entries of equals the sum of the squares of the absolute values of the eigenvalues of (counted with multiplicity) if and only if is normal — this is a consequence of the spectral theorem together with the trace identity . This gives a quick numerical test one can apply after finding eigenvalues, though the direct definitional check ( vs ) or the norm-equality check from part (a) remain the standard hands-on methods for a specific matrix.