The Adjoint of a Linear Map
Suppose you have a linear map between two inner product spaces. You want to understand it through the lens of the inner product itself. If scales, rotates, and shears vectors, is there a companion map going the other way? This companion map, , would capture exactly how interacts with angles and lengths. This companion, called the adjoint of , turns out to exist always. It is also unique, and it encodes almost every structural fact we care about. This includes symmetry, orthogonality, positivity, and eventually the singular value decomposition itself. The adjoint matters because it is the correct linear-algebraic generalization of the conjugate transpose of a matrix. It also matters because so many important classes of operators (self-adjoint, normal, unitary/orthogonal) are defined purely in terms of how relates to . Before we can even define rigorously, we need a tool. That tool converts every linear functional on an inner product space into an inner-product-with-a-fixed-vector. This is the Riesz Representation Theorem, and it is the engine that makes the whole construction work. The big picture: an inner product space lets you measure lengths and angles. A linear functional is a way of extracting a number from a vector. Riesz representation says that on a finite-dimensional (or complete) inner product space, every functional is secretly "take the inner product with some fixed vector." Once we know this, we can define by declaring that for all . This works because the left side is a linear functional of for each fixed . So Riesz representation produces the vector automatically. This article proves existence and uniqueness of via Riesz representation. It establishes the basic algebraic identities (, , , etc.). It also proves that in orthonormal bases the matrix of is the conjugate transpose of the matrix of . It sets up the language needed for Self-Adjoint Operators, Normal Operators, and eventually the Singular Value Decomposition.
- Every linear functional on a finite-dimensional inner product space has a unique vector with for all — this is Riesz representation.
- For linear, the adjoint is the unique linear map satisfying for all .
- Existence and uniqueness of both come directly from Riesz representation, applied one at a time.
- The adjoint is conjugate-linear-friendly: , , , .
- In orthonormal bases, the matrix of is the conjugate transpose of the matrix of .
- Key idea: the adjoint is the abstract, basis-free generalization of "flip the matrix and conjugate," produced entirely by the Riesz representation theorem.
Where this lives today
The adjoint is not a curiosity; it is the hinge on which the entire structure theory of operators on inner product spaces turns. Self-adjoint operators () generalize real symmetric and complex Hermitian matrices, and by the Spectral Theorem (built later using Self-Adjoint Operators and Normal Operators) they are exactly diagonalizable with real eigenvalues in an orthonormal basis. Normal operators () are exactly the operators diagonalizable by a unitary/orthonormal change of basis, unifying Hermitian, skew-Hermitian, and unitary operators under one umbrella. The Singular Value Decomposition, arguably the most computationally important factorization in applied linear algebra, is built by analyzing the self-adjoint, positive operator . Beyond pure linear algebra: in quantum mechanics, observables are modeled as self-adjoint operators on a Hilbert space precisely because the adjoint machinery guarantees real "eigenvalues" (measurement outcomes). In statistics and data science, the normal equations for least squares are literally , an adjoint identity in disguise, underlying linear regression and the Moore–Penrose pseudoinverse. In numerical linear algebra and engineering, adjoint methods power efficient gradient computations (adjoint-state methods in PDE-constrained optimization, and backpropagation itself can be viewed as repeated adjoint computation through a composition of linear maps). In signal processing, the discrete Fourier transform matrix is unitary, meaning its inverse equals its adjoint, which is why Fourier synthesis and analysis are adjoint operations of each other.
Ask the tutor: How does the adjoint being self-adjoint and positive lead directly into constructing the Singular Value Decomposition?
Let and be finite-dimensional inner product spaces over (where or ), and let be linear. The adjoint of is the map satisfying
(Below we prove that such a map exists, is unique, and is itself linear.)
Intuition
Think of as a machine converting inputs in to outputs in . The defining equation of the adjoint says: measuring against in is the same number as measuring against in . The adjoint is the operator that lets you "move across the inner product" from one side to the other, at the cost of moving it from -side to -side and back. The key structural fact underneath this is the Riesz representation theorem: linear functionals on an inner product space are nothing but "inner product with a fixed vector." A linear functional eats a vector and returns a scalar; Riesz representation says every such is for a unique . Once you fix , the map is exactly such a functional on , so it must equal for a unique depending on . We define . This is the entire proof strategy: Riesz representation is invoked once for every , and linearity of in is then checked separately. Geometrically, in the real, finite-dimensional case with orthonormal bases, is a matrix , and is ; over it is . The picture below shows this "transpose and conjugate the matrix" idea alongside the abstract "move across the inner product" idea, which are the same fact viewed from coordinates versus viewed intrinsically.
Why finite-dimensionality is used
Everything below assumes and are finite-dimensional. This hypothesis is used twice: once to guarantee that orthonormal bases exist (needed for Riesz representation's proof), and once to guarantee that a linear functional is automatically continuous/well-behaved, which is automatic in finite dimensions but requires extra care (completeness) in infinite dimensions.
Let be a finite-dimensional inner product space over , and let be a linear functional. Then there exists a unique vector such that
Existence. Since is finite-dimensional, it has an orthonormal basis (this uses Existence of Orthonormal Bases, e.g. via Gram–Schmidt). Define
We check that represents . Let be arbitrary. Because is an orthonormal basis, we can write where (this is the standard orthonormal-basis coordinate formula, itself a direct computation using ). Then by linearity of ,
On the other hand, using linearity of the inner product in the first slot and conjugate-linearity in the second slot,
Both expressions equal , so for all . This proves existence.
Uniqueness. Suppose both satisfy for all . Then for all ,
Taking gives , i.e. . By positive-definiteness of the inner product, , so .
∎Let be finite-dimensional inner product spaces over , and let be linear. Then there exists a unique linear map such that
Existence. Fix . Define by
This is linear in : for and ,
using linearity of and linearity of the inner product in its first argument. So is a linear functional on . By Riesz Representation Theorem applied to , there is a unique vector, call it , such that
which is exactly the required identity . This defines a function (well-defined precisely because Riesz representation produces a unique vector for each ).
is linear. Let and . For every ,
using conjugate-linearity of the inner product in the second slot. Continuing,
again using conjugate-linearity in the second slot in reverse. Since this holds for all , the uniqueness clause of Riesz representation (applied to the functional , which is represented by two candidate vectors) forces
Hence is linear.
Uniqueness of as a map. Suppose is any linear map with for all . Fix . Then for all ,
so for all . Taking gives , so . Since was arbitrary, .
∎Let be finite-dimensional inner product spaces over . Let and be linear, and let . Then: 1. . 2. . 3. . 4. (note the order reversal), where . 5. .
Each identity is proved by exhibiting the defining inner-product identity and invoking uniqueness of the adjoint.
(1) For all ,
By the uniqueness half of the adjoint theorem (applied to the map ), the unique operator satisfying this identity is ; since also satisfies it, .
(2) For all ,
using conjugate-linearity in the second slot to move across as . By uniqueness, .
(3) By definition, satisfies for all . Taking complex conjugates of both sides (both sides are scalars),
using conjugate symmetry of the inner product. Relabeling ( swapped in role), this says exactly that for all ,
which is precisely the defining property of the adjoint of applied to : it says satisfies the identity that defines . By uniqueness of the adjoint of , we conclude .
(4) is linear (composite of linear maps). For all ,
using the defining property of first, then of . By uniqueness, .
(5) For all , trivially , so satisfies the defining property of its own adjoint; by uniqueness .
∎Let be finite-dimensional inner product spaces over with orthonormal bases of and of respectively. Let be linear, and let be the matrix of with respect to these bases, meaning
Then the matrix of with respect to the bases (domain) and (codomain) satisfies
Because the bases are orthonormal, matrix entries can be extracted by taking inner products against basis vectors: for any linear map between spaces with orthonormal bases (domain) and (codomain), if , then taking of both sides and using orthonormality gives
Apply this to : . Apply this to : . Now compute using the defining property of the adjoint and conjugate symmetry:
Thus for all , which is exactly the statement that , the conjugate transpose of .
∎Worked examples
Example 1 (an explicit non-square, non-symmetric complex map). Let and , each with the standard inner product , and standard orthonormal bases. Let be given by the matrix
so . By the theorem just proved, the matrix of with respect to the standard bases is :
So .
Sanity check via the defining identity. Take and . Compute . Then
Compute . Then
Both sides equal , confirming for this pair, consistent with the theorem.
Example 2 (adjoint of a differentiation-like operator via change of orthonormal basis, and composition). Let with the standard inner product, and let be given, in the non-orthonormal-looking but actually we will use an orthonormal basis , , by
Since here, conjugation is trivial, so has matrix , i.e. . Now let's verify the composition law (property 3 above) and the composition-reversal law (property 4) with a second operator, to see the algebra in action on an asymmetric example. Let have matrix (also real, orthonormal standard basis). Then has matrix . Compute directly: matrix of is :
So should have matrix . Now compute directly, matrix :
Indeed , confirming numerically (this is of course just the familiar fact from matrix algebra, matching the abstract identity proved above). This also illustrates why the order must reverse: in general (check: ), so in general either, and only the reversed order is correct.
The Riesz representation theorem, and hence existence of the adjoint, can fail if is infinite-dimensional and merely an inner product space (not complete, i.e. not a Hilbert space). Here is a concrete failure. Let be the space of sequences of real numbers with only finitely many nonzero terms, equipped with the inner product (a finite sum, since only finitely many terms are nonzero). This is a genuine inner product space — positive-definite, symmetric, bilinear — but it is infinite-dimensional and not complete. Define the linear functional
This is well-defined (finite sum for each ) and linear.
Claim: there is no with for all . Suppose such a existed. Since , only finitely many are nonzero; say for all . Let be the standard basis vector with a in position and elsewhere; . Then
but
since . This contradicts . So no such exists, and has no Riesz representative. Consequently, if one tried to define an adjoint using this (e.g. as for some operator landing appropriately), the construction used in the existence proof breaks down entirely: there is no vector to call . This is exactly why the theorem restricts to finite-dimensional spaces (or, in the general theory, complete inner product spaces / Hilbert spaces) — dropping finite-dimensionality (without substituting completeness) can genuinely destroy existence of the adjoint.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| both finite-dimensional | exists and is unique (main theorem) |
| infinite-dimensional, not complete | Riesz representation can fail; adjoint may not exist (see counterexample) |
| infinite-dimensional but complete (Hilbert space) | Riesz representation and adjoint existence still hold, with a more delicate proof (Cauchy sequences replace finite bases); beyond this article's scope |
| Adjoint matrix is the ordinary transpose (conjugation is trivial) | |
| Adjoint matrix is ; forgetting the conjugate is a very common error | |
| Non-orthonormal basis used | The formula "matrix of = conjugate transpose of matrix of " is false in general; it requires orthonormal bases |
| is also an operator on ; this is the setting for Self-Adjoint Operators and Normal Operators |
The mathematician behind it
Origins · 1 minFrigyes Riesz and how this was discovered
Riesz worked in Szeged and Budapest, and his representation theorems (for linear functionals on Hilbert spaces, and separately for measures) are cornerstones of functional analysis. The theorem bearing his name used here is the finite-dimensional shadow of a deeper Hilbert-space result; both express the same idea, that continuous linear functionals are inner products against a fixed vector, and both routinely appear disguised inside proofs about adjoints, dual spaces, and weak convergence.
Does every linear map between inner product spaces have an adjoint?
Yes, provided both spaces are finite-dimensional (or more generally, complete Hilbert spaces). The existence proof relies on the Riesz Representation Theorem, which guarantees that every linear functional on the domain can be written as an inner product against a fixed vector. Applying this one output vector at a time produces automatically. If the space is infinite-dimensional and not complete, Riesz representation can fail, as the counterexample in this article shows, and then the construction used to build has no vector to output.
Is the adjoint the same as the inverse?
No, they are entirely different in general. The adjoint always exists for any linear map between finite-dimensional inner product spaces, while the inverse only exists when is bijective. They coincide precisely for unitary (complex) or orthogonal (real) operators, where , meaning . This special coincidence is exactly why unitary/orthogonal operators are so important: their adjoint doubles as their inverse.
Why does the matrix of the adjoint involve a conjugate, not just a transpose?
The conjugate appears because the complex inner product is conjugate-linear in one slot (by convention, the second slot here), not bilinear. When you move a scalar across the inner product from the second slot, it comes out complex-conjugated. Tracing through the proof that , conjugate symmetry of the inner product forces a conjugation, giving . Over , conjugation is the identity, so the formula reduces to the familiar plain transpose.
Does the formula "matrix of adjoint = conjugate transpose" work for any bases?
No — it requires orthonormal bases in both the domain and codomain. The proof extracts matrix entries using the formula , which is only valid when form an orthonormal basis (otherwise you would need to solve a linear system against the Gram matrix to extract coordinates). If you use a non-orthonormal basis, the matrix of is instead the conjugate transpose of conjugated by Gram matrices of the two bases, which generally is not simply .
How does the adjoint relate to self-adjoint and normal operators?
Self-adjoint operators are defined by the equation , and normal operators by ; both definitions are meaningless without first knowing exists and is unique, which is exactly what this article establishes. These operator classes generalize familiar matrix classes (symmetric, Hermitian, skew-Hermitian, unitary, orthogonal) to the operator level, and their spectral properties (real eigenvalues, orthogonal eigenspaces, diagonalizability by an orthonormal basis) are proved using the algebraic identities for developed here.
Can the adjoint change if I change the inner product on or ?
Yes, absolutely. The adjoint is defined entirely in terms of the inner products on and , so changing either inner product generally changes , even though itself is unchanged. For instance, the matrix formula "conjugate transpose" is valid only in an orthonormal basis for the given inner product; switching to a different inner product changes which bases are orthonormal, and hence changes the adjoint's matrix representation, even in the same basis.
Is the map itself linear?
Almost, but not quite in the naive sense: it is additive, , but it is conjugate-linear in scalars, since rather than . Over this distinction disappears because conjugation is trivial, so the adjoint map is genuinely linear in the real case. Over , this conjugate-linearity is an essential and often-tested feature, directly traceable to the conjugate-linearity of the inner product itself.