Triangularization of Operators
Every matrix over the complex numbers can be simplified. But not every matrix can be diagonalized. A shear-like operator such as one sending and has no chance of being diagonal in any basis. It is not even invertible in the right way. It is nilpotent, and nilpotent operators other than are never diagonalizable. So the natural question is: what is the best possible simplification available to every operator on a complex vector space? The answer is triangularization. This means finding a basis in which the matrix has zeros everywhere below the diagonal. This question matters because triangular matrices retain almost all the computational virtues of diagonal matrices. This holds even though they are less symmetric than diagonal ones. Their determinant and trace are visible by inspection. Their eigenvalues are exactly the diagonal entries. Polynomial expressions in them are easy to control. Triangularization is the structural fact that makes possible the later, sharper theorems of the subject. It is the raw material from which the Cayley-Hamilton Theorem and the theory of Generalized Eigenvectors are built. The big picture is that triangularization is a statement about chains of invariant subspaces, called flags. A single Invariant Subspace tells you an operator respects some subspace. A full flag — a nested sequence of invariant subspaces of every dimension from up to — tells you the operator can be built up one dimension at a time. The existence of such a flag is guaranteed for every operator over by the Existence of Eigenvalues over C. This is exactly equivalent to the existence of an upper-triangular matrix representation. This article gives the precise definition of triangularizability. It proves the fundamental existence theorem by induction on dimension. It works two concrete asymmetric examples by hand. It shows exactly why the complex numbers (or more precisely, splitting of the characteristic polynomial) cannot be dispensed with.
- An operator is triangularizable if some basis represents it by an upper-triangular matrix.
- Equivalently, there is a flag of invariant subspaces with .
- Over (or any algebraically closed field), every operator on a finite-dimensional space is triangularizable.
- The diagonal entries of an upper-triangular representation are always exactly the eigenvalues of the operator, with multiplicity.
- Triangularizability is strictly weaker than diagonalizability — nilpotent shifts are triangularizable but not diagonalizable.
- Key idea: the existence of one eigenvector plus induction on the quotient space builds a full flag, hence an upper-triangular matrix.
Where this lives today
Triangularization is the load-bearing beam beneath much of matrix analysis. In numerical linear algebra, the Schur decomposition — writing with unitary and upper triangular — is the numerically stable computational cousin of this theorem, avoiding the instability of computing eigenvector bases directly; it underlies most industrial-strength eigenvalue algorithms (the QR algorithm converges toward exactly such a triangular form). In control theory and systems engineering, upper-triangular state-space realizations reveal cascade structure: later states feed forward from earlier ones, exactly as the flag interpretation predicts. In algebra, triangularization is the first step toward the Cayley-Hamilton Theorem, whose cleanest proof triangularizes an operator and then evaluates its own characteristic polynomial diagonal-block by diagonal-block. It is also the scaffolding for the theory of Generalized Eigenvectors and Jordan form, since a triangular matrix is only one refinement away from block-diagonal Jordan structure. In quantum mechanics and representation theory, simultaneous triangularization of families of commuting operators (Lie's theorem for solvable Lie algebras) generalizes this single-operator result to whole algebras of operators acting compatibly on the same flag.
:::quiz[If is upper triangular with diagonal entries , what is ?]
- ✓
:::quiz[A basis makes upper triangular if and only if which condition holds for every ?]
- is a scalar multiple of alone
- ✓
- has all coordinates equal in the basis
Ask the tutor: How does refining the invariant flag further, using generalized eigenvectors, upgrade a triangular matrix into full Jordan canonical form?
Let be a finite-dimensional vector space over a field with , and let be a linear operator.
Upper-triangular matrix. An matrix is upper triangular if whenever ; that is, every entry strictly below the main diagonal is .
Matrix of with respect to a basis. Given an ordered basis of , the matrix of with respect to , written , is the matrix whose -th column records the coordinates of in the basis :
Triangularizable. is triangularizable if there exists an ordered basis of such that is upper triangular. Equivalently — as will be proved — is triangularizable if and only if there is a chain of subspaces
such that for every . Such a chain is called a flag for , and it is invariant if every term is a -Invariant Subspace.
Intuition
Think of an upper-triangular matrix as encoding a construction process rather than a static array of numbers. The equation says that sends into the span of — never further out. So if you build one basis vector at a time, never needs information about vectors "later" in the list to describe where the "earlier" ones go. This is exactly the statement that the subspaces are nested and invariant: maps each stage of the construction into itself. Diagonalization asks for something stronger: that acts on each by pure scaling, with no contribution from the other basis vectors at all. Triangularization only asks that not reach forward; it is allowed to reach backward, mixing 's image with all of . This laxity is precisely what makes triangularization achievable so generally, while diagonalization is not. The picture below shows the "staircase" support pattern of an upper-triangular matrix, and the flag of invariant subspaces it corresponds to.
Second figure: eigenvalues visible on the diagonal
Once a basis triangularizes , the eigenvalues of can be read directly off the diagonal, because factors as a product of the diagonal entries minus .
Let be an algebraically closed field (for instance ), let be a vector space over with , and let be a linear operator. Then: 1. There exists a flag of -invariant subspaces with for each . 2. Consequently, there exists an ordered basis of such that is upper triangular. 3. Conversely, if some ordered basis of (over any field) makes upper triangular with diagonal entries , then the characteristic polynomial of factors as
so the multiset is exactly the multiset of eigenvalues of counted with algebraic multiplicity.
Proof of (1) and (2), by strong induction on . Technique: induction on dimension, using the existence of an eigenvector to descend to a quotient space of dimension . Base case . Any operator on a -dimensional space is multiplication by a scalar (fix any nonzero ; then for some scalar , since ). Set , . Both are trivially -invariant, , , and this is the required flag. The single basis vector gives , a upper-triangular matrix. Inductive step. Let and assume the result (both parts (1) and (2)) holds for every operator on every vector space of dimension strictly less than , over the same algebraically closed field . Since is algebraically closed and , the Existence of Eigenvalues over C (which holds verbatim over any algebraically closed field, by the same argument using that the characteristic polynomial, or the polynomial , has a root) guarantees that has at least one eigenvalue , with a corresponding eigenvector . Set , a -dimensional subspace. It is -invariant: for any scalar , . Form the quotient space , which has dimension (by the Rank-Nullity Theorem applied to the quotient map, or directly since ). Define the induced operator
This is well defined: if , then , so (by invariance of ), hence . Linearity of follows immediately from linearity of and linearity of the quotient map , . By the inductive hypothesis applied to on the -dimensional space , there is a flag of -invariant subspaces
and an ordered basis of with for each , giving an upper-triangular matrix for . Now pull this structure back to along the quotient map . For each , define
Since is linear and surjective and is a subspace, is a subspace of containing , and by the correspondence between subspaces of and subspaces of containing ,
This gives , with strict inclusions because the dimensions strictly increase, and for . Together with this is exactly a chain of the required dimensions. Each is -invariant. Let , so . Since is -invariant, . But by definition of the induced operator. Hence , which means precisely . This proves , establishing (1).
Basis construction proving (2). Choose vectors so that for each (possible since is surjective). We claim is a basis of making upper triangular. Linear independence and spanning. The images form a basis of . A standard fact about quotients (if spans a complement-defining line and is a basis of then is a basis of ) gives that is a basis: indeed, if , apply to get in (since ), forcing by independence of the ; then forces since . This shows vectors are linearly independent in an -dimensional space, hence is a basis. Triangularity. We have . For : since , write
for scalars . Then , so . Hence there is a scalar with
This holds for every , which is exactly the condition for to be upper triangular. This proves (2), completing the induction.
Proof of (3). Suppose is upper triangular with respect to some basis , over any field (this direction needs no algebraic closure). Then is also upper triangular, with diagonal entries . The determinant of an upper-triangular matrix equals the product of its diagonal entries: this is proved by cofactor expansion along the first column, since has only one possibly-nonzero entry in the first column (the entry ), reducing to times the determinant of the upper-triangular submatrix obtained by deleting the first row and column; induction on then gives
Since the characteristic polynomial of is (a basis-independent quantity), it factors completely with roots exactly , each appearing with the multiplicity it has as a factor. This is precisely the statement that the diagonal entries are the eigenvalues of with algebraic multiplicity, proving (3).
∎Worked examples
Example 1 — a genuinely non-diagonalizable operator, triangularized by hand. Let be given in the standard basis by
This matrix is already upper triangular, so by part (3) of the theorem its eigenvalues (with multiplicity) are , read straight off the diagonal — no computation of the characteristic polynomial is needed, though we can check: , confirming eigenvalues (multiplicity ) and (multiplicity ). We verify is not diagonalizable, to show that triangularizability is doing real work here. For : solve ,
Row reducing: the second and third rows are identical, giving , with free. So the eigenspace for is , only -dimensional — but the algebraic multiplicity is . Since geometric multiplicity () is less than algebraic multiplicity (), is not diagonalizable. Yet is triangularizable (trivially, since is already triangular), consistent with the theorem: triangularizability is guaranteed over regardless of diagonalizability. The flag of invariant subspaces guaranteed by the theorem is visible directly from the columns:
and one checks , , — matching the columns of exactly.
Example 2 — triangularizing an operator not initially given in triangular form. Let have standard matrix
This is not upper triangular. We find a basis that makes it so, following the constructive steps of the proof. Step 1: find an eigenvalue. The characteristic polynomial is
So is the unique eigenvalue, with algebraic multiplicity . Step 2: find an eigenvector for . Solve :
Row 2 is times row 1, so the system reduces to , i.e. . Take . Set . Step 3: extend to a basis. Choose any vector completing to a basis of ; take , since are clearly independent (their matrix has determinant ). Step 4: compute for . We have
confirming is an eigenvector with eigenvalue , as it must be.
Express this in the basis : solve , i.e. . From the first coordinate, . From the second, . So
Hence
which is upper triangular, with diagonal entries matching the double eigenvalue found above. This operator is a scalar multiple of the identity plus a nonzero nilpotent piece (its Jordan-block shape foreshadows the theory of Generalized Eigenvectors) and is not diagonalizable — the eigenspace for here is only -dimensional, since has rank — yet it is triangularizable, exactly as the theorem promises.
Drop the hypothesis that is algebraically closed, and work instead over . Let and let be the rotation by :
The characteristic polynomial is , which has no real roots. So has no eigenvalue in , hence no eigenvector in . Suppose, for contradiction, that some real basis made upper triangular, say . Then , forcing to be a real eigenvector of with real eigenvalue — contradicting the fact just established that has no real eigenvalue. So is not triangularizable over , even though is finite and is a perfectly good linear operator. The proof of the Triangularization Theorem breaks down at the very first inductive step: the appeal to the Existence of Eigenvalues over C (or, more precisely, existence of a root of the characteristic polynomial in ) simply fails when , because does not split over . This shows the hypothesis "algebraically closed field" (or "characteristic polynomial splits into linear factors over ") is not a technical convenience — it is load-bearing. Over , the very same , viewed as an operator on , does have eigenvalues and is triangularizable (in fact diagonalizable) there.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| , any , finite dimension | Always triangularizable (theorem applies unconditionally) |
| , characteristic polynomial splits over | Triangularizable (the proof only needs the field to contain all the roots, not full algebraic closure) |
| , characteristic polynomial does not split | May fail to be triangularizable — see the rotation counterexample |
| diagonalizable | Automatically triangularizable, with off-diagonal entries all zero |
| triangularizable | Not necessarily diagonalizable (Examples 1 and 2 above) |
| Infinite-dimensional | The inductive proof does not apply; the very notion of a finite basis/flag needs reformulation |
| Non-unique triangularizing basis | The theorem asserts existence, not uniqueness — many bases can triangularize the same |
The mathematician behind it
Origins · 1 minCamille Jordan and how this was discovered
Jordan's foundational 1870 treatise Traité des substitutions et des équations algébriques organized the emerging theory of what we now call linear operators, developing canonical forms for matrices well before the modern axiomatic language of vector spaces existed. His name attaches to the finest possible triangularization — the Jordan Canonical Form — in which the flag of invariant subspaces is refined all the way down to blocks recording exactly how far an operator is from being diagonalizable. Triangularization is the coarser, more robust ancestor of that refinement: it needs only the existence of eigenvalues, while the full Jordan form needs the theory of generalized eigenvectors built on top of it.
Is every square complex matrix similar to an upper-triangular matrix?
Yes. This is exactly the content of the Triangularization Theorem applied to the operator on represented by that matrix in the standard basis. Since is algebraically closed, the characteristic polynomial of any complex operator splits completely into linear factors, so the inductive construction of an eigenvector, followed by passage to a quotient space, always succeeds. The resulting change-of-basis matrix satisfies with upper triangular. This is a purely existential statement: it guarantees such a exists but the proof's inductive method, while explicit in principle, is rarely the most efficient computational route; numerical algorithms use the Schur decomposition instead.
Does triangularizability imply diagonalizability?
No, and this is one of the most important distinctions in the subject. Triangularizability only requires that each lie in the span of ; diagonalizability requires the much stronger condition that be a scalar multiple of alone. Nilpotent operators other than zero are the sharpest illustration: they are always triangularizable (their only eigenvalue is ), yet never diagonalizable, because a nonzero diagonalizable nilpotent operator would have to be the zero matrix in its eigenbasis, contradicting nonzero-ness. Both worked examples in this article exhibit triangularizable, non-diagonalizable operators explicitly.
Why does the proof need to pass to a quotient space rather than a subspace complement?
Working with a complement such that is tempting, but generally does not map into itself — only is guaranteed invariant, not any particular complement. The quotient sidesteps this: the induced map is always well defined on the quotient regardless of which complement one might have chosen, precisely because being invariant is exactly the condition needed for to be independent of the choice of representative . This makes the induction clean and choice-free.
Is the triangularizing basis unique?
No. The theorem only asserts existence, and in general many different bases triangularize the same operator, often with different orderings or different off-diagonal entries, though the multiset of diagonal entries (the eigenvalues with multiplicity) is an invariant of itself, by part (3) of the theorem, and does not depend on which triangularizing basis is chosen. Even the order in which eigenvalues appear along the diagonal can typically be permuted by choosing the eigenvector flag in a different order, subject to compatibility with invariance at each stage.
How does this relate to the Cayley-Hamilton theorem?
One of the cleanest proofs of the Cayley-Hamilton Theorem triangularizes first, using exactly this theorem, and then shows that annihilates every basis vector one at a time, by induction using the flag structure. Without the guarantee that a triangularizing basis exists, that argument has no foothold. This is a primary reason triangularization is placed before Cayley-Hamilton in the logical development of the subject, rather than after.
What happens for operators over R whose characteristic polynomial does not split?
Such operators are not triangularizable over as shown in the rotation counterexample, but they can always be triangularized after extending scalars to (viewing the same matrix as acting on ). Real linear algebra instead uses real canonical forms with rotation-scaling blocks along the diagonal in place of single complex eigenvalues, reflecting the pairs of complex-conjugate eigenvalues that arise from real matrices with non-real roots of their characteristic polynomial.
Does the theorem require T to be invertible?
No, invertibility plays no role anywhere in the statement or proof. The zero operator, for instance, is (trivially) already upper triangular — indeed diagonal — in every basis, and singular operators are triangularized by the same inductive construction as invertible ones; the only place an eigenvalue is used is to seed the induction, and eigenvalues can certainly be zero.