Dual Maps and the Transpose
Every linear map between vector spaces has a shadow map. This shadow map runs in the opposite direction between their dual spaces. It is called the dual map or transpose map. This map encodes exactly the same information as the original map. But it acts on linear functionals rather than on vectors. The question this article answers is deceptively simple. If is linear, is there a natural linear map built from ? If so, what does it look like in coordinates? The surprising and beautiful answer is this. This abstractly-defined map, when written in matrices with respect to dual bases, is literally the transpose of the matrix of . It is the same transpose you learned to compute in a first course. It is now revealed as a coordinate expression of a coordinate-free construction. This matters because it explains why the transpose behaves the way it does. It explains why . It explains why row rank equals column rank. It explains why the transpose of an invertible matrix is invertible, with inverse the transpose of the inverse. All of these facts look like bookkeeping identities when proved by direct computation with matrix entries. But they become nearly automatic once you see them as consequences of the functorial nature of duality. The dual map reverses arrows and reverses composition order. This is exactly what one would guess from the way functions pull back. The big picture is that duality gives every construction in linear algebra a "mirror" construction. The dual map is the mirror of a linear map itself. Annihilators are subspaces of the dual space consisting of functionals vanishing on a given subspace. They turn out to be exactly the right language for describing the kernel and image of the dual map. This description is in terms of the kernel and image of the original map. This sets up the machinery used later to prove that row rank and column rank of a matrix coincide. This is one of the most useful and initially mysterious facts in the subject. This article gives the precise definition of the dual map. It proves the transpose theorem in full. It works out two detailed examples with asymmetric non-square matrices. It develops the annihilator identities relating , to , . It assumes familiarity with The Dual Space and Dual Bases and The Matrix of a Linear Map.
- For linear , the dual map is defined by , precomposition.
- is always linear, regardless of what looks like; duality reverses the direction of arrows.
- With respect to dual bases, the matrix of is the transpose of the matrix of .
- Composition reverses: , mirroring .
- Annihilators satisfy and (finite dimensions).
- Key idea: the transpose of a matrix is not an ad hoc operation — it is the coordinate representation of the natural "pullback" map on dual spaces.
Where this lives today
The dual map and transpose underlie the notion of the adjoint operator in functional analysis and quantum mechanics: for a bounded linear operator between Hilbert spaces, the Hermitian adjoint is built from the same precomposition idea, combined with the Riesz representation identifying a Hilbert space with its own dual. In numerical linear algebra and statistics, the transpose of a design matrix appears throughout least-squares regression, where the normal equations arise directly from differentiating a quadratic form, and the annihilator perspective explains why the residual vector lies in the orthogonal complement (a metric cousin of the annihilator) of the column space. In control theory and signal processing, the transpose of a state matrix governs the "dual system," used in observability/controllability duality — itself a direct descendant of the annihilator identities and . In algebraic geometry and representation theory, the dual (or "transpose") of a linear map between vector spaces is the basic building block of contravariant functors, and the transpose theorem is the shadow, in the category of vector spaces, of a much more general categorical duality. Finally, the annihilator machinery developed here is precisely the tool used to give a clean, basis-free proof that the row rank and column rank of a matrix are equal, connecting this article directly to Rank of a Matrix.
Ask the tutor: How does the annihilator identity give a basis-free proof that row rank equals column rank?
Let and be vector spaces over a field , and let be a linear map. Let and denote the dual spaces and respectively. The dual map (or transpose) of is the map
That is, is the linear functional on defined by for all . When are finite-dimensional with ordered bases of and of , with dual bases of and of , the matrix of the dual map is , computed with respect to these dual bases in the same convention used for : the -th column of records the coordinates of in the basis .
Intuition
Think of a linear map as a machine that pushes vectors forward from into . A linear functional on is a machine that measures vectors in , producing a scalar. If you want to measure a vector using , the natural thing to do is first push forward into via , and then measure the result with . This composite operation, , is itself a linear functional on — call it . So while pushes vectors forward from to , the process of building new functionals out of old ones runs backward: functionals on give rise to functionals on . This reversal of direction is the essential content of duality, and it is why points the opposite way from . The transpose-of-a-matrix phenomenon is the coordinate shadow of this reversal. If is represented by an matrix (using coordinate vectors, an -dimensional input turning into an -dimensional output), the dual map takes a functional on the -dimensional target — represented by a row vector, or equivalently a column vector of length once we fix the dual basis coordinates — and returns a functional on the -dimensional source. The bookkeeping of matching up "row acting on column" versus "column acting on row" forces the matrix of to have rows and columns, with entries equal to those of but with rows and columns swapped: exactly .
Central results
Let be vector spaces over and let be linear. Then the map
is a well-defined linear map from to .
Well-defined (lands in ). For fixed , the composite is a composition of linear maps and , hence linear (composition of linear maps is linear, a basic fact about ). So for every .
Linearity of itself. We must check is additive and homogeneous as a function of . Let and . Then
using the definition of addition of functionals in . Since this holds for all , the functionals and agree on all of , so
For scalars, let and . For all ,
so . Thus is additive and homogeneous, hence linear.
∎Let be vector spaces over . (a) If is the identity map, then . (b) If and are linear, then , where and .
(a) For , , so is the identity map on .
(b) Both and are maps ; we show they agree on every . By definition,
On the other hand,
using the definition of applied to the functional . Composition of functions is associative, so , and the two expressions coincide for every . Hence .
∎Let be an -dimensional vector space with ordered basis , and let be an -dimensional vector space with ordered basis , both over . Let and be the corresponding dual bases of and . Let be linear and let be its matrix. Then
Write , , , so that
By definition of the matrix of a linear map with respect to dual bases, the matrix is the matrix whose -th column () gives the -coordinates of ; that is,
and we must show for all , i.e. . Fix . By definition of the dual map, , a functional on . We evaluate both sides of the coordinate expansion at each basis vector of . Using the fundamental property of a dual basis, (Kronecker delta), the right-hand side gives
The left-hand side gives
again using linearity of and the defining property of the dual basis of . Equating the two evaluations, for every and every . This says precisely that the entry of equals the entry of , i.e. .
∎If is an matrix and is an matrix over , then .
Let be vector spaces with ordered bases of dimensions respectively (for instance with standard bases), and let , be the linear maps with and with respect to these bases. Then (The Matrix of a Linear Map, the composition-of-maps-corresponds-to-product-of-matrices rule). By the previous theorem applied three times,
each with respect to the appropriate dual bases. By the Lemma on functoriality, , and applying the matrix-of-a-composition rule to (a composition ) gives . Since and are the same map, their matrices with respect to the same dual bases coincide:
Now we introduce annihilators, which describe the kernel and image of in terms of those of .
Let be a vector space over and let be a subspace. The annihilator of is
It is straightforward to check is a subspace of : it contains the zero functional, and is closed under addition and scalar multiplication because those operations are checked pointwise and , .
Let be finite-dimensional vector spaces over and let be linear. Then: (a) For any subspace with , , we have . (b) . (c) . (d) .
(a) Extend a basis of to a basis of (possible by the basis extension theorem, since is finite-dimensional). Let be the corresponding dual basis of . We claim , which has dimension since dual basis vectors are linearly independent. If , then for any with , since whenever and here . Since every element of is a linear combination of , linearity gives for all ; hence . This shows . Conversely, let . Write in the dual basis. For , evaluate: (since and the sum collapses to the term). But and force , so for all . Thus . This proves , and combined with the reverse inclusion, , so .
(b) Let . By definition, iff in , i.e. iff for every (since is the functional , and it is the zero functional exactly when it vanishes on every ). As ranges over , ranges over all of , so this condition is equivalent to for all , i.e. . Hence .
(c) We first show . Let and . Then
so every functional in vanishes on , i.e. . For the reverse inclusion, we compare dimensions, which suffices since we already have one containment. By The Dual Space and Dual Bases (finite-dimensionality gives ) together with the Rank–Nullity theorem applied to ,
Since , and by part (b) together with part (a) (applied to , of dimension ),
Hence . On the other hand, by part (a) applied to (of dimension by Rank–Nullity for , where ),
So and are both subspaces of , one contained in the other, and both of the same finite dimension ; a subspace of a finite-dimensional space that has the same dimension as the ambient space it sits inside must equal it. Hence .
(d) This was shown in the course of proving (c): .
∎Worked examples
Example 1: an explicit map and its transpose, checked directly against the definition. Let with standard basis and let with standard basis , over . Define by
so that
Let be the dual basis of and the dual basis of . We compute directly from the definition , and check the result against the transpose theorem. By definition, is the functional on sending . It suffices to evaluate on the basis vectors of , since a functional is determined by its values on a basis. For : , and . So . For : , and . So . For : , and . So . Reading off coordinates in , the matrix has as its -th column the coordinates of :
which is exactly , confirming the theorem in this instance. Note the shapes: is (three rows, two columns), and is , matching .
Example 2: annihilators, kernel, and image for a rank-deficient map. Let , , both with standard bases, and let have matrix
Notice the second row is twice the first, so ; this is a genuinely rank-deficient, asymmetric example (not full rank, not square). Kernel of . Solve : the system reduces to the single equation . A basis for is obtained from two free parameters, say :
so , consistent with Rank–Nullity: . Image of . Since rank is , is -dimensional, spanned by the first column image, e.g. , so . Transpose map and its matrix. By the transpose theorem, with respect to standard dual bases,
Check . First compute directly: sends the standard dual basis vector to the functional with coordinate vector (first column of ), and to — a scalar multiple of the first. So
a -dimensional subspace of , matching as guaranteed by part (d) of the theorem. Now compute directly and compare. A functional (identified with row vectors acting by dot product) annihilates exactly when
i.e. and . So
which is exactly computed above — confirming part (c) of the theorem in this concrete, rank-deficient, non-square case. Check . A functional satisfies iff , i.e. for all , i.e. as a row-vector times matrix. Concretely forces . So , a -dimensional subspace of . Independently, , matching exactly.
Consider , the (infinite-dimensional) vector space of all polynomials over , and let , the subspace of polynomials with zero constant term. This has codimension in (a complement is the span of the constant polynomial ), so one might hope for an analogue of "" reading " has dimension equal to the codimension of ", i.e. dimension . But for infinite-dimensional is vastly larger than itself, and the annihilator is not -dimensional. Indeed, the "evaluation at " functional certainly lies outside (it does not vanish on all of 's complement, in fact it is nonzero on the complement), but there are many functionals other than scalar multiples of that vanish on all of . For example, one can extend a basis of (any basis of the polynomials-vanishing-at- subspace, e.g. ) together with the constant to a Hamel basis of , then define a functional sending and every basis vector of to as well — that is only the zero functional, so instead consider that actually has uncountably many linearly independent functionals vanishing on once itself is infinite-dimensional and admits many linear functionals on a complement-free description; concretely, because but is already infinite, the space of functionals on restricting to zero on is naturally identified with , and while is -dimensional (so is also -dimensional), the subtlety is that still holds by the general isomorphism theorem for annihilators — so in this particular example is -dimensional. To get a genuine failure of the counting formula, instead take , the zero subspace of the infinite-dimensional space . The formula "" would predict (an appropriate infinite cardinal), which is at least formally consistent, but the proof technique itself breaks down: the proof of part (a) crucially used basis extension of a finite list to a basis, followed by reading off dual-basis coordinates of an arbitrary using only finitely many nonzero coordinates. In infinite dimensions, an element of need not be expressible as a finite linear combination of "dual basis vectors" at all — the dual space of an infinite-dimensional space is not spanned by any naive analogue of a dual basis, because is strictly larger than the span of the functionals dual to a Hamel basis of (a functional can be nonzero on infinitely many basis vectors simultaneously, which no finite linear combination of the can achieve). This is precisely why the theorem is stated only for finite-dimensional : the proof genuinely requires representing every functional in as a finite linear combination of dual-basis vectors, a step that fails outside finite dimensions. Dropping finite-dimensionality breaks the proof, and indeed the clean dimension count fails to hold in the naive cardinal-arithmetic sense expected, since for infinite-dimensional always strictly exceeds itself (a cardinality fact), making any such formula for , where , already inconsistent with .
Scope, edge cases & common traps
| Situation | What happens | Why |
|---|---|---|
| finite-dimensional | well-defined, matrix is , annihilator identities hold exactly | Theorem above, full proof given |
| or infinite-dimensional | still well-defined and linear (Theorem on linearity needs no finite-dim hypothesis) | Definition and linearity proof used no dimension count |
| Dimension-counting corollaries (annihilator dimension formula, ) | Can fail or need reinterpretation | Proof uses finite bases and Rank–Nullity, both finite-dimensional tools |
| Non-square (, ) | is ; genuinely maps between spaces of different dimensions | Matches shapes: vs |
| Composition order | , reversed | Precomposition reverses order, proved via associativity of function composition |
The mathematician behind it
Origins · 1 minHermann Grassmann and how this was discovered
Hermann Grassmann developed the algebra of extension ("Ausdehnungslehre", 1844), introducing what we would now recognize as vector spaces, exterior algebra, and — implicitly — dual pairings between spaces of extended magnitudes, decades before the language of linear algebra was standardized. His work was so far ahead of the notational and conceptual conventions of his era that it was largely ignored by contemporaries and only fully appreciated after his death, once mathematicians such as Giuseppe Peano and later the Bourbaki school built the modern axiomatic framework of vector spaces and dual spaces in which Grassmann's ideas found their natural home. The formal notion of a dual map and its transpose, in the abstract coordinate-free form used in this article, crystallized in the early twentieth century as functional analysis and abstract algebra matured, but its conceptual seed — treating "measuring devices" (functionals) on a space as objects with their own algebraic structure, transformable by maps on the underlying space — traces back to this pioneering and long-underappreciated work.
Why is the dual map defined by precomposition rather than postcomposition?
Precomposition is the only option that type-checks. Given and a functional (so ), the composite is well-defined because the output of , living in , matches the input of . Postcomposing would require applying something to the output of , which is already a scalar, so there is no natural map to postcompose with in general. This forces the dual map to run backward: takes functionals on to functionals on , giving , the reverse of .
Does the transpose theorem depend on the choice of dual bases, or is it basis-independent?
The map itself is completely basis-independent — it is defined purely by , with no reference to any basis. What depends on a choice of bases is the matrix representing . The theorem states that if you use the specific dual bases associated to chosen bases of and (not arbitrary bases of and ), then the matrix of works out to be exactly . Using different bases of or not arising as duals of bases of would generally produce a different-looking (though similar) matrix.
Is , the dual of the dual map, the same as ?
For finite-dimensional and , yes, in a precise sense: there is a canonical isomorphism sending to the "evaluation functional" , and under this identification (and the analogous one for ), corresponds exactly to . This is why duality is often called an involution on finite-dimensional spaces. In infinite dimensions the canonical map is still injective but typically not surjective, so genuinely lives on a larger space than , and the identification breaks down without further hypotheses (e.g. reflexivity in Banach space theory).
How does this explain why row rank equals column rank of a matrix?
The column rank of is . By part (d) of the theorem, this equals . But by the transpose theorem, has matrix , so , which is the column rank of — exactly the row rank of . Chaining these equalities gives column rank of equals row rank of , with no appeal to row reduction at all. This is the cornerstone argument developed further in Rank of a Matrix.
Can the dual map be an isomorphism even when is not injective or not surjective?
No — for finite-dimensional spaces, is injective if and only if is surjective, and is surjective if and only if is injective. This follows directly from the annihilator identities: injective means , i.e. , which by the dimension formula for annihilators forces , i.e. surjective (and conversely). The symmetric statement for gives the other equivalence. In particular is an isomorphism exactly when is.
What goes wrong if I try to apply the transpose theorem using two different, unrelated bases of and instead of dual bases?
The theorem's proof relies crucially on the defining relations and , which hold only because , are the dual bases to . If you instead pick arbitrary bases of and with no relation to bases of and , the matrix of with respect to those bases will differ from by change-of-basis matrices on each side; it need not literally equal , though it will always be similar in structure (related by conjugation). The clean identity "" is a special feature of using dual bases specifically, not a basis-free fact about arbitrary representations.
Is the annihilator the same as the orthogonal complement from an inner product space?
They are closely related but conceptually distinct. The annihilator lives in the dual space and consists of functionals vanishing on ; it makes sense for any vector space, with no inner product required. The orthogonal complement lives in itself and requires an inner product to make sense of "perpendicular." When is a finite-dimensional inner product space, the Riesz map identifies with and carries exactly onto under this identification, which is why the two notions are often conflated in practice — but the annihilator is the more primitive, purely linear-algebraic notion.