Orthonormal Bases and Coordinates
Suppose you want the coordinates of a vector relative to a basis of a five-dimensional space. In general this means solving a linear system. You write the vector as an unknown combination of basis vectors. Then you expand, and match coefficients. This can be genuinely painful. But suppose the basis vectors are pairwise orthogonal. Suppose also each has length one. Then the entire computation collapses into a single inner product per coordinate. No system to solve at all. This is the central payoff of working with an orthonormal basis. Once a basis is orthonormal, extracting coordinates becomes mechanical. The -th coordinate of a vector is simply its inner product with the -th basis vector. This formula is often called the Fourier coefficient formula. It is the linear-algebraic ancestor of the Fourier series formula from analysis. It explains why orthonormal bases are the preferred coordinate systems throughout mathematics, physics, and engineering. The idea matters because it converts two hard problems into easy, formulaic ones. Those problems are finding coordinates, and computing inner products or norms of vectors given in coordinates. Once coordinates relative to an orthonormal basis are known, the inner product of two vectors becomes the ordinary dot product of their coordinate tuples. The norm becomes the ordinary Euclidean length of the coordinate tuple. All of the geometric intuition of Euclidean space transports faithfully to any finite-dimensional inner product space. This holds provided one uses an orthonormal basis. This article proves the Fourier coefficient formula. It also proves the componentwise formulas for inner products and norms. It builds directly on Orthogonality and Orthogonal Sets and the Triangle Inequality and Norm Properties. It sets the stage for the Gram-Schmidt Process, which manufactures orthonormal bases out of arbitrary ones. It also prepares for Orthogonal Complements and the Bessel and Parseval Identities. These extend these ideas to infinite-dimensional and non-basis settings.
- An orthonormal basis is a basis whose vectors are pairwise orthogonal and each have norm .
- If is an orthonormal basis, every vector satisfies .
- The scalar is called the -th Fourier coefficient of ; it is exactly the -th coordinate.
- Relative to an orthonormal basis, inner products become dot products of coordinate tuples: .
- Norms become Euclidean lengths of coordinate tuples: .
- Key idea: orthonormality turns "solve a linear system for coordinates" into "compute inner products."
Where this lives today
Orthonormal coordinates are the computational backbone of enormous swaths of applied mathematics. In numerical linear algebra, algorithms such as QR decomposition and the Gram-Schmidt Process exist precisely to convert an arbitrary basis into an orthonormal one, after which solving least-squares problems, computing projections, and inverting systems all become numerically stable, componentwise operations rather than ill-conditioned matrix inversions. In signal processing, discrete and continuous Fourier transforms, wavelet transforms, and the discrete cosine transform (which underlies JPEG image compression) are all instances of expanding a signal in an orthonormal basis and reading off Fourier coefficients via inner products — exactly the formula proved above, applied to function or sequence spaces. In quantum mechanics, physical states are vectors in a complex Hilbert space, and an orthonormal basis of eigenstates lets physicists compute transition amplitudes and probabilities as inner products of state vectors with basis vectors — the Fourier coefficients here have direct physical meaning as probability amplitudes. In statistics and machine learning, principal component analysis produces an orthonormal basis (the eigenvectors of a covariance matrix) in which data coordinates are uncorrelated, and dimensionality reduction relies on truncating the componentwise sum from part (c) of the theorem. In computer graphics and robotics, orthonormal frames (rotation matrices) are used constantly because their inverse is their transpose, which is a direct matrix restatement of the coordinate formula. In cryptography and coding theory, orthonormal (and more generally orthogonal) bases underlie lattice constructions and error-correcting code design, where controlling norms via componentwise sums of squares is essential to bounding error probabilities.
Ask the tutor: If I only know an orthogonal (not orthonormal) basis for a subspace, how do I adapt the Fourier coefficient formula to compute the orthogonal projection of a vector onto that subspace?
Let be a finite-dimensional inner product space over (where or ), with inner product conjugate-linear (or linear, if ) in the second slot, and . A list of vectors in is called orthonormal if
An orthonormal basis of is an orthonormal list that is also a basis of , i.e. . Given an orthonormal basis of and a vector , the scalar
is called the -th Fourier coefficient of relative to this basis.
Intuition
Think of an orthonormal basis as a set of perfectly perpendicular, unit-length measuring sticks. To find "how much" of is inside a vector , you do not need to disentangle contributions from at all — projecting onto the line through automatically ignores every other direction, precisely because they are orthogonal to . The inner product is that projection length (with sign, or phase in the complex case). Contrast this with a skewed, non-orthogonal basis: to read off the coordinate of along one axis, you must first account for how the axes lean into each other, which is exactly what solving a linear system (inverting a change-of-basis matrix) does. Orthonormality removes the leaning entirely: the "change of basis matrix" whose columns are the becomes an isometry (orthogonal or unitary), and its inverse is simply its conjugate transpose — so recovering coordinates is a matter of taking inner products, not inverting a matrix. The second piece of intuition is that once you have these coordinates, the abstract inner product space "looks like" with the standard dot product. Lengths, angles, and orthogonality in are computed by ordinary Euclidean formulas applied to the coordinate tuples. The orthonormal basis is the dictionary that translates 's geometry into the geometry you already know from .
Let be a finite-dimensional inner product space over , and let be an orthonormal basis of . Then:
(a) Coordinate formula. For every ,
That is, the (unique) scalars with are exactly .
(b) Componentwise inner product. For all , writing and ,
(c) Componentwise norm (Parseval-type identity for a basis). For every ,
We use the fact, following from linear independence of a basis, that every has a unique representation with ; this is simply the defining property of a basis and does not depend on orthonormality.
Proof of (a). Fix and write for the (unique) scalars given by the basis property. Fix an index . Using linearity of the inner product in the first slot and conjugate-linearity (or linearity, in the real case) in the second slot only as needed for scalars already in , compute
where the first equality is the definition of and the second is linearity of the inner product in its first argument (an axiom of the inner product, hence not requiring further proof here). By orthonormality of we have , so every term in the sum vanishes except the term, which equals . Hence
for every . Substituting these values of back into gives
which is the claimed formula. This also confirms that the abstract coefficients (guaranteed to exist and be unique by the basis property) coincide with the Fourier coefficients .
Proof of (b). Let and be the expansions from part (a), so and . Using linearity of the inner product in the first argument and conjugate-linearity in the second argument (the sesquilinearity axioms of the inner product; in the real case, ordinary bilinearity), we compute:
By orthonormality, , so only the terms with survive:
This is exactly the claimed componentwise formula. Note this used only orthonormality of the basis and the sesquilinearity axioms already assumed for the inner product on ; no circularity is involved since we never assumed the conclusion of the theorem to derive it.
Proof of (c). Apply part (b) with . Then for each , so
where we used that for every scalar (a basic property of the modulus, true in both and ). This proves (c).
∎If is a basis (not necessarily orthonormal) of a vector space and , then there is exactly one tuple of scalars with .
Existence is the spanning property of a basis. For uniqueness, suppose . Subtracting, . Since is linearly independent, every coefficient in a linear combination summing to must be ; hence for all .
∎This lemma was invoked silently in part (a) of the theorem above to guarantee that some unique tuple of coefficients exists before we identified it with the Fourier coefficients; it is a basic fact about bases, established independently of orthonormality and inner products, so its use is not circular.
Worked examples
Example 1 — coordinates and inner product in with a genuinely non-standard orthonormal basis. Let with the standard dot product. Consider the three vectors
Step 1: verify orthonormality. Compute norms:
Compute pairwise inner products:
So is orthonormal, and since it consists of orthonormal (hence linearly independent — an orthonormal list is automatically linearly independent, since applying to a dependence relation forces for each ) vectors, it is a basis, hence an orthonormal basis. Step 2: find the coordinates of . By the Fourier coefficient formula,
Check: ✓. No linear system was solved: each coordinate came from one dot product. Step 3: compute two ways. Directly, . Via part (c) of the theorem, . They agree, confirming the componentwise norm formula. Step 4: an inner product computation. Let . Its coordinates are
By part (b), . Directly, . They match.
Example 2 — a complex orthonormal basis and Fourier coefficients as complex numbers. Let with the standard Hermitian inner product . Take the orthonormal basis
Step 1: verify orthonormality.
So is orthonormal in , hence (being linearly independent vectors) an orthonormal basis. Step 2: find coordinates of .
Compute ; more carefully, — let's expand directly: . Simplify cleanly: (using , and is not needed — recompute term by term: ). So
Compute . So
Check: . First component: ✓ Second component: ✓ Both components recover exactly, confirming the coordinate formula in the complex, non-real case. Step 3: norm check. Directly . Via coordinates: , and . Sum: . ✓ This illustrates that in the complex case the correct formula uses , not — an easy place for sign/conjugation errors to creep in.
Drop orthogonality but keep the vectors a basis and even keep them unit vectors — that is, weaken the hypothesis " orthonormal" to merely " a basis with for each ." The coordinate formula then fails. Work in with the dot product. Let
Both have norm : trivially, and . They are linearly independent (not parallel), so is a basis of . But
so the list is not orthogonal, hence not orthonormal. Take . Its true coordinates relative to solve :
Numerically and . Now compute the would-be Fourier coefficients, i.e. :
These numbers, and , are not equal to the true coordinates and . Indeed
So plugging into gives the wrong vector entirely when the basis fails to be orthogonal, even though every vector still has unit length. This shows that unit length alone (without pairwise orthogonality) is not enough for the coordinate formula: the cross terms for , which the proof of part (a) relied on vanishing, do not vanish here, and they corrupt the computation.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| finite-dimensional, real inner product space | All three formulas hold exactly as stated, with real Fourier coefficients. |
| finite-dimensional, complex inner product space | Formulas hold verbatim, but coefficients are complex; the norm formula needs , not squares without absolute value. |
| orthonormal but (not a basis) | The coordinate formula (a) fails as stated; instead is the orthogonal projection of onto , and only equals when already lies in that span. This is the seed of the Bessel and Parseval Identities. |
| Basis orthogonal but not normalized () | Must rescale: correct coefficient is , not directly. |
| Basis normalized but not orthogonal | Coordinate formula fails, as shown in the counterexample above; genuine linear-system solving (or Gram-Schmidt) is required. |
| Infinite-dimensional inner product space, orthonormal sequence | Sums become infinite series; convergence and completeness issues arise — treated properly under Parseval's identity and Hilbert space theory, beyond this article's finite-dimensional scope. |
The mathematician behind it
Origins · 1 minJoseph Fourier and how this was discovered
Jean-Baptiste Joseph Fourier is best known for his 1822 treatise Théorie analytique de la chaleur ("The Analytical Theory of Heat"), in which he claimed that essentially arbitrary periodic functions could be expanded as infinite sums of sines and cosines. Fourier's original coefficient formulas — obtained by integrating a function against sine and cosine functions — are precisely the infinite-dimensional, function-space analogue of the coordinate formula proved above, with the orthonormal basis replaced by the orthogonal trigonometric system and the finite sum replaced by an infinite series. Though Fourier's work predates the modern abstract definition of an inner product space by nearly a century, the structural insight — that an orthogonal (or orthonormal) system of "basis functions" lets you read off expansion coefficients by a single integral (an inner product) rather than by solving simultaneously for all coefficients at once — is exactly the content of the theorem proved here, transplanted from function spaces to general finite-dimensional inner product spaces.
Does the Fourier coefficient formula require to be finite-dimensional?
The theorem as proved here is stated and proved for finite-dimensional , where "basis" means a finite linearly independent spanning list and the sum is a genuine finite sum, requiring no analysis. In infinite-dimensional inner product spaces (pre-Hilbert or Hilbert spaces), an analogous formula holds for orthonormal sequences, but the sum becomes an infinite series, and one must address convergence of that series and whether it actually equals (completeness of the orthonormal system). That extension is the subject of the Bessel and Parseval identities, which build on exactly this finite-dimensional result but require additional machinery from analysis.
Why does the formula use and not in the complex case?
In a complex inner product space, the two quantities differ by conjugation: . The convention adopted here — linear in the first argument, conjugate-linear in the second — makes the correct coefficient of in the expansion of , as the proof of part (a) shows directly. If your textbook uses the opposite convention (linear in the second argument), the coefficient formula instead reads ; the mathematics is identical, only the convention for which slot is linear differs, so always check which convention is in force before applying the formula.
Is every basis of a finite-dimensional inner product space "close to" orthonormal?
No, not automatically — as the counterexample demonstrates, a basis of unit vectors can still fail to be orthonormal, and a basis with all pairwise-orthogonal vectors can fail to be normalized. However, every finite-dimensional inner product space does possess an orthonormal basis, and moreover any orthonormal list can be extended to one; this existence result is precisely what the Gram-Schmidt Process establishes constructively, by systematically subtracting off projections to enforce orthogonality and then rescaling to enforce normalization.
How does this relate to matrices being "orthogonal" or "unitary"?
If is an orthonormal basis of (with the standard inner product) and is the matrix whose columns are , then part (b) of the theorem, applied to the standard basis vectors, is exactly the statement that (where is the conjugate transpose), i.e. is unitary (or orthogonal if ). The coordinate formula is then equivalent to the matrix identity , i.e. : recovering coordinates by inner products is the same fact as an orthogonal/unitary matrix having its transpose (conjugate transpose) as its inverse.
What goes wrong if I try to use this formula with an orthogonal, but not orthonormal, basis?
If is merely orthogonal (pairwise inner products zero) but for some , the correct coefficient of in the expansion of is , not alone. This follows immediately by rerunning the proof of part (a): expanding and taking gives , so . Forgetting to divide by is a common bookkeeping error when working with orthogonal (rather than orthonormal) eigenbases, such as Legendre or Hermite polynomial bases before normalization.
Does the componentwise inner product formula assume and are expressed in the same orthonormal basis?
Yes, essentially — the formula requires that and come from the same list . If 's coordinates were computed relative to one orthonormal basis and 's relative to a different orthonormal basis, the raw dot product of the two coordinate tuples generally does not equal ; one must first convert both to a common basis (via a change-of-basis, i.e. unitary/orthogonal, matrix) before the componentwise dot-product shortcut applies.