Generalized Eigenvectors
Not every square matrix is diagonalizable. Yet every operator on a finite-dimensional complex vector space is still built entirely from a handful of scalars: its eigenvalues. The gap between these two facts is filled by generalized eigenvectors. Consider the matrix with a single eigenvalue but a Jordan block structure. It has "too few" ordinary eigenvectors to span the space. So we ask a weaker question. Instead of vectors killed outright by , what about vectors killed by some power ? This small relaxation turns out to be exactly enough. The idea matters because it rescues the entire diagonalization program from operators that resist it. Where an eigenvector satisfies , a generalized eigenvector satisfies this only "eventually." This happens after repeated application of . Tracking how these vectors form an ascending chain of null spaces reveals a stabilization phenomenon. This phenomenon is tied intimately to the Minimal Polynomial and to the algebraic multiplicity of from the Characteristic Polynomial. The big picture is that generalized eigenvectors let us decompose any finite-dimensional complex vector space. It becomes a direct sum of subspaces, one per eigenvalue. Each is invariant under and each has dimension equal to the algebraic multiplicity. On each such subspace, restricted looks like plus a nilpotent piece. This is a dramatic simplification even when true diagonalization is impossible. This is the bridge connecting Geometric vs Algebraic Multiplicity to a genuine structural decomposition. This article develops the ascending chain of null spaces . It proves that this chain must stabilize. It identifies the stable value with the generalized eigenspace. It also proves the key dimension theorem that makes the whole theory work. It sets up, but does not complete, the full Generalized Eigenspace Decomposition and the Jordan Canonical Form.
- A generalized eigenvector for eigenvalue is a nonzero with for some positive integer .
- The null spaces form an ascending chain that strictly increases until it stabilizes, then stays fixed forever.
- Stabilization happens by step at the latest; the stable subspace is the generalized eigenspace .
- equals the algebraic multiplicity of in the characteristic polynomial — this is the central dimension theorem.
- Ordinary eigenspaces can be too small to span ; generalized eigenspaces are never too small — together they span (over ).
- Key idea: replacing "killed by " with "eventually killed by some power of " recovers enough vectors to reconstruct the whole space.
Where this lives today
Generalized eigenspaces are the working engine behind solving linear systems of ordinary differential equations when is not diagonalizable: the general solution involves terms like precisely when is a generalized eigenvector of rank , and these polynomial-times-exponential terms are unavoidable exactly when Jordan blocks of size greater than appear. In control theory and stability analysis of dynamical systems, the size of Jordan blocks at eigenvalues on the stability boundary determines whether solutions grow polynomially, a distinction generalized eigenvectors make precise. In numerical linear algebra, the sensitivity of eigenvalue computations to perturbation is governed by whether nontrivial generalized eigenvectors exist (defective matrices are notoriously ill-conditioned for eigenvalue algorithms). In quantum mechanics and the theory of Jordan blocks for non-Hermitian (non-normal) operators, generalized eigenvectors describe resonance and decay phenomena that ordinary eigenvectors cannot capture. Finally, the entire theory is the direct staircase to the Jordan Canonical Form, which packages generalized eigenspaces and their internal nilpotent structure into the cleanest possible matrix representative of a similarity class.
:::quiz[Why does the counterexample with the backward-shift operator on fail to produce a finite-dimensional generalized eigenspace?]
- Because is not an eigenvalue of
- Because is infinite-dimensional, so the pigeonhole bound on chain length has no finite to invoke ✓
- Because has no eigenvectors at all
- Because is not linear
Ask the tutor: How does the direct sum of all the generalized eigenspaces combine to give the full Jordan Canonical Form of an operator?
Let be a finite-dimensional vector space over a field (take for the deepest results), and let be a linear operator. Let be an eigenvalue of . A vector is a generalized eigenvector of corresponding to if and
for some positive integer . The generalized eigenspace of corresponding to , denoted , is the set of all generalized eigenvectors corresponding to together with the zero vector:
This is a linear subspace of , since each is a subspace and they are nested increasingly (proved below), so their union is a subspace.
Intuition
Picture the chain of subspaces . The first term is the ordinary eigenspace: vectors that sends exactly to times themselves. The second term contains vectors that are not eigenvectors, but which maps into the eigenspace. Applying repeatedly to such a vector eventually annihilates it, just more slowly. Think of as a "clock" that ticks a vector toward zero; ordinary eigenvectors die in one tick, generalized eigenvectors die in finitely many ticks. A single Jordan block makes this concrete. The vector is an honest eigenvector: . The vector is not an eigenvector — — but . So needs two ticks to die; it is a generalized eigenvector of "rank 2." The eigenspace is only one-dimensional (spanned by ), too small to span , but the generalized eigenspace is all of .
worked-examples-preface
Before the theorem, note the two facts the picture suggests: the chain of null spaces cannot increase forever inside a finite-dimensional space, and once two consecutive terms of the chain are equal, every later term equals them too. Both facts are proved rigorously below as part of establishing that is achieved at a finite, bounded stage.
Let be finite-dimensional with , let be linear, and consider the chain
Then:
(a) for every .
(b) If for some , then for all .
(c) There exists such that , and consequently for all .
(a) If then . So .
(b) We show by induction on that ; the base case is the hypothesis. Assume for some ; we show . By part (a), , so we only need the reverse inclusion. Let , so , i.e. , i.e. (inductive hypothesis). Then , i.e. , i.e. . This proves , hence equality, completing the induction. Thus for all .
(c) Suppose, for contradiction, that no such exists, i.e. are pairwise distinct as consecutive pairs — that is, (strict inclusion) for every . A strict inclusion of subspaces of a finite-dimensional space forces a strict increase in dimension: if are subspaces of a finite-dimensional space then , since a basis of can be extended to a basis of using at least one further vector (this extension exists because means some vector of is not in , hence not in the span of the basis of , so it can be adjoined to a linearly independent set). Applying this at each step,
This is a strictly increasing sequence of nonnegative integers, so . But and , forcing , i.e. . Then also (the last inequality from part (a), which gives ), forcing . This contradicts the assumption that all inclusions up through index are strict only if we needed to be strict too — but we assumed strictness for only, so no contradiction arises there; instead we have directly exhibited with , which is exactly the existence claim with . Combined with part (b), for all .
∎Let be a vector space over with , let be linear, and let be an eigenvalue of with algebraic multiplicity (the multiplicity of as a root of the characteristic polynomial ). Then:
(a) , and this common subspace equals ; that is,
(b) is invariant under : .
(c) .
We use the technique of decomposing as an internal direct sum of -invariant complementary subspaces, together with basic facts about the characteristic polynomial under block-triangular matrix representations.
(a) Apply the Stabilization Lemma above with : the chain stabilizes at some , and stays fixed at for all . In particular it has stabilized by index , so . Since and the chain is eventually constant equal to for all indices (and the terms before are all contained in by the ascending property), the union equals exactly:
(b) Let , so where . Since and commute (as is a polynomial in ), we have
so . Hence is -invariant.
(c) This is the substantive claim. Let . We show by exhibiting a basis of adapted to and analyzing the resulting block form of the matrix of . Step 1: Construct a -invariant complement. We claim there is a subspace with and . To see this, first note -type intersection arguments are unnecessary; instead argue directly via the operator . Consider , the image of . By the rank-nullity theorem applied to the linear map ,
We claim , i.e. . Since the dimensions already sum to , it suffices to show . Let . Write for some . Since , we get , so . But by part (a) (stabilization at index ), , so , giving . Hence , and by the dimension count, . Set . Both summands are -invariant: is -invariant by part (b). For : if , then (using again that commutes with ). So is -invariant. Step 2: Restrict to and show it is invertible on . Suppose and , i.e. (chain ascending). Then by the direct sum decomposition. So is injective, hence (since is finite-dimensional and as is a polynomial in and is -invariant) is a bijection of onto itself, i.e. is invertible. Equivalently, is not an eigenvalue of . Step 3: Compute the characteristic polynomial via the block decomposition. Choose a basis of and a basis of ; since with both summands -invariant, the matrix of in the combined basis is block-diagonal:
The characteristic polynomial of a block-diagonal matrix is the product of the characteristic polynomials of the blocks (expand the determinant using the block structure of , whose determinant is the product of the determinants of the diagonal blocks since it is block upper triangular). Hence
Now, on , the operator where is nilpotent: indeed every satisfies by part (a), so . A nilpotent operator on a -dimensional space has characteristic polynomial (its only eigenvalue is , with algebraic multiplicity since the characteristic polynomial has degree and is a root of multiplicity equal to — this follows because a nilpotent operator's minimal polynomial divides for the ambient dimension, forcing every eigenvalue to be , and the characteristic polynomial, having degree and as its only root, must equal ). Therefore where is nilpotent, and
(the characteristic polynomial of shifted: substituting reduces this to the characteristic polynomial of evaluated at , which is ). By Step 2, is not an eigenvalue of , so does not divide . Combining, where the second factor is not divisible by . By definition, the algebraic multiplicity of is exactly the exponent of in the full factorization of ; the above shows this exponent is exactly . Hence .
∎Worked examples
Example 1 — a operator with a mixed Jordan structure, eigenvalue . Let act on (standard basis ) by the matrix
This is already block-diagonal: a Jordan block at , a block at , and a block at . The characteristic polynomial is , so has algebraic multiplicity and has . Compute the chain for . Let .
- : solve . Row 1 gives ; row 4 gives , so . Free: . So , dimension . This is the ordinary eigenspace — geometric multiplicity of is , strictly less than , confirming is not diagonalizable.
- . Solve : only constraint is , i.e. . So , dimension .
- , same kernel as : dimension . So the chain has stabilized: .
Thus , with , exactly matching the theorem. Note stabilization occurred at index , well before the theorem's guaranteed bound of — the bound is only an upper bound, not always sharp. For : has as an honest eigenvector with , and one checks already, dimension , so and no higher powers were needed. Consistently, , illustrating (without yet proving in general) the forthcoming Generalized Eigenspace Decomposition.
Example 2 — an operator given abstractly, not already in block form. Let be given by
The characteristic polynomial (upper triangular, so it's the product of ) is , giving , . For : .
- : from row 3, ; from row 1 with , . Free variable . So , dimension — geometric multiplicity , less than .
- . Solve : need , all forcing ; free. So , dimension .
- . Same as — same kernel, dimension . Chain stabilized at index 2.
So , dimension . Explicitly, is an ordinary eigenvector, and satisfies but , so is a genuine generalized eigenvector of exact rank (killed by but not by ). For : since is upper triangular with only in the bottom-right, one finds directly where a genuine eigenvector must be computed: solve : gives free, , . Eigenvector , and is already -dimensional , so .
Drop the hypothesis and the stabilization theorem collapses. Let , the (infinite-dimensional) space of all polynomials in over , and let be the derivative-like operator
(multiplication by ). Take , so is just multiplication by . Then : multiplying a nonzero polynomial by never gives . Indeed for every , since forces in the polynomial ring (an integral domain). So actually here every kernel is trivial and there is no generalized eigenvector at all for — consistent, since is not even an eigenvalue of (no nonzero polynomial satisfies ). To see actual failure of stabilization behavior (an ever-growing, never-stabilizing chain with an honest eigenvalue), instead let and let be the backward shift-type operator
(formally, differentiation composed with reindexing; concretely for and ). Here is an eigenvalue with eigenvector (the constant polynomial), since . Now , which has dimension for every : the chain
is strictly increasing forever and never stabilizes. There is no finite with , and the "generalized eigenspace" is all of , an infinite-dimensional space, so the dimension theorem's conclusion ("," a finite number) cannot even be stated meaningfully. This is precisely what the finite-dimensionality hypothesis in the Stabilization Lemma rules out: without it, the pigeonhole argument bounding the chain length by has no to appeal to.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| diagonalizable | already at the first step; no higher powers needed. |
| not an eigenvalue of | , and in fact for all (since is invertible), so . |
| Field is , characteristic polynomial has non-real roots | The dimension theorem's proof, which used a full factorization over into linear factors, does not directly apply; the sum of generalized eigenspaces need not exhaust . |
| Stabilization can fail entirely, as shown in the counterexample; "algebraic multiplicity" itself may not be well-defined. | |
| Stabilization index | Guaranteed by index , but often occurs much earlier (Example 1 stabilized at index 2 inside a 4-dimensional space). |
The mathematician behind it
Origins · 1 minMarie Ennemond Camille Jordan and how this was discovered
Camille Jordan trained as an engineer at the École Polytechnique before turning to mathematics, where he became one of the most prolific French mathematicians of his era. He is remembered for the Jordan curve theorem in topology, for foundational work in group theory connecting to Galois theory, and — most relevant here — for the canonical form of a matrix that bears his name. Jordan's 1870 treatise Traité des substitutions et des équations algébriques developed the classification of linear substitutions (matrices) up to similarity, in which the ascending chains of generalized eigenspaces play the decisive structural role. His work sat at the crossroads of algebra and what would later become linear algebra as a distinct discipline; the notion of a generalized eigenvector, though not named as such by Jordan in modern terms, is the precise mechanism his canonical form exploits to handle operators that fail to be diagonalizable.
How does a generalized eigenvector differ from an ordinary eigenvector?
An ordinary eigenvector satisfies exactly, i.e. in one step. A generalized eigenvector only needs for some positive integer , possibly larger than . Every ordinary eigenvector is automatically a generalized eigenvector (take ), but the converse can fail: a vector might require ticks of before vanishing, as with in a Jordan block. The generalized eigenspace therefore always contains the ordinary eigenspace, often strictly, and it is this extra room that allows generalized eigenspaces to have the "correct" dimension (algebraic multiplicity) even when ordinary eigenspaces are too small.
Why must we take a union over all powers rather than fixing one specific ?
Different generalized eigenvectors can require different numbers of steps to vanish under . In a Jordan block, the top basis vector needs only , the middle one needs , and the bottom one needs . If we fixed we would only recover the ordinary eigenspace; if we fixed some intermediate , we might still miss vectors requiring more steps. Taking the union captures every vector that is eventually annihilated by some power, regardless of how many steps it needs. The stabilization lemma then shows this union is achieved by a single finite power (at most ), so in practice one need only compute up to that power.
Does the Dimension Theorem hold over the real numbers ?
The proof given here relies on decomposing via the characteristic polynomial's root at , and the argument that is not divisible by still works over for a single real eigenvalue , so the theorem remains valid for each real eigenvalue of a real operator. What can fail over is the global consequence that the generalized eigenspaces of all eigenvalues together span : the characteristic polynomial may have non-real roots that contribute no real eigenvalue and hence no generalized eigenspace inside the real vector space, leaving the sum of real generalized eigenspaces strictly smaller than . Over , where the characteristic polynomial always splits into linear factors, this obstruction disappears.
How is the generalized eigenspace related to the minimal polynomial?
The Minimal Polynomial of factors as over , where is the smallest positive integer such that , i.e. the exact stabilization index for eigenvalue . This is also the size of the largest Jordan block associated to . It satisfies , with exactly when is diagonalizable on (no Jordan blocks larger than size 1). So while the algebraic multiplicity tells you the dimension of the generalized eigenspace, the minimal polynomial's exponent tells you the depth of the chain — how many steps are truly needed to reach stabilization.
Can a vector be a generalized eigenvector for two different eigenvalues simultaneously?
No, and this is provable directly. Suppose satisfies and for distinct scalars . One can show the generalized eigenspaces and for distinct eigenvalues intersect only in , by an argument generalizing the classical proof that eigenvectors for distinct eigenvalues are linearly independent (apply suitable polynomials in and , which are coprime as polynomials, to isolate ). Consequently the sum over distinct eigenvalues is always a direct sum, a fact used crucially in the Generalized Eigenspace Decomposition.
What goes wrong if I only check and without verifying the chain has truly stabilized?
If the two dimensions happen to be unequal at some early stage, you cannot stop there — you must keep going until you find two consecutive equal dimensions, because the chain can have several genuine strict jumps before it stabilizes (as in a Jordan block of size 3, where ). Stopping after only one comparison risks under-counting the generalized eigenspace and computing the wrong dimension, which would then fail to match the algebraic multiplicity — a red flag that should prompt rechecking the next power in the chain.
Why is finite-dimensionality of needed, and is there any analogue in infinite dimensions?
Finite-dimensionality is what makes the pigeonhole argument work: a strictly increasing chain of subspace dimensions inside an -dimensional space cannot continue past steps, forcing stabilization. In infinite dimensions this bound disappears, and as the counterexample with the backward-shift operator on shows, the chain can increase forever without ever stabilizing, so no finite-dimensional generalized eigenspace exists. In functional analysis, generalized eigenspace ideas do reappear (e.g. for operators with compact resolvent, or in the theory of Riesz projections for isolated points of the spectrum), but they require substantially more machinery — spectral theory and complex analysis — rather than the elementary linear-algebraic pigeonhole argument used here.