The Cauchy-Schwarz Inequality
Suppose you want to measure how "aligned" two vectors are. You want to do this without any reference to angles drawn in a picture. Given only an abstract Inner Product Space and the number , is there a bound? Specifically, one relating this number to the sizes of and alone. The Cauchy–Schwarz inequality answers this decisively. The magnitude of the inner product of two vectors never exceeds the product of their norms. This single fact is the hinge on which the entire theory of inner product spaces turns. The inequality matters because it is the technical engine behind almost everything that follows. It lets us define the angle between two abstract vectors. This includes even vectors that are functions, sequences, or random variables. It does so by guaranteeing that a certain ratio always lies in . It is also the single ingredient needed to prove the Triangle Inequality and Norm Properties. This applies for the norm induced by an inner product. In turn, this is what makes that norm a genuine norm, rather than just a convenient formula. The big picture is this: an inner product space carries more structure than a mere vector space with a norm. It carries a notion of "how much two vectors point the same way." Cauchy–Schwarz converts this qualitative idea into a hard numerical inequality. It is provable from the inner product axioms alone. There is no appeal to geometry, coordinates, or dimension. It works identically in , in , in spaces of polynomials. It also works in infinite-dimensional spaces of square-integrable functions. This article gives the precise statement. It includes a complete proof using orthogonal projection onto a single vector. It also gives a full analysis of when equality holds. It gives the geometric reading of the inequality as a bound on the cosine of an angle. It closes with worked examples in and in a function space. It also gives a counterexample showing why the inner product structure is essential. Finally, it looks at where the inequality resurfaces throughout mathematics, physics, and statistics.
- For vectors in an inner product space, , always.
- The proof projects onto the line spanned by and expands the nonnegative norm of the leftover piece.
- Equality holds exactly when and are linearly dependent (one is a scalar multiple of the other).
- It works verbatim over or , in finite or infinite dimensions.
- It is exactly what is needed to define and to prove the Triangle Inequality and Norm Properties.
- Key idea: orthogonal projection onto a single vector turns "angle bound" into a one-line nonnegativity argument.
Where this lives today
The Cauchy–Schwarz inequality is not a curiosity confined to geometry — it is structural machinery used across mathematics and its applications.
In probability and statistics, applied to the inner product on random variables with finite variance, it yields , the fact underlying the bound for the Pearson correlation coefficient .
In quantum mechanics, the inner product is the Hermitian inner product on a Hilbert space of quantum states, and Cauchy–Schwarz underlies the derivation of the Heisenberg uncertainty principle, bounding the product of variances of non-commuting observables.
In signal processing and machine learning, it justifies bounds on inner products of feature vectors (used constantly in kernel methods and in bounding cosine similarity scores, always guaranteed to lie in ).
In numerical analysis and optimization, it gives error bounds for approximation methods, including bounds used to control the convergence rate of conjugate-gradient-type iterative solvers.
In pure mathematics, it is the direct prerequisite for the Triangle Inequality and Norm Properties (which needs exactly this bound to control cross terms when expanding ), and it motivates the study of Orthogonality and Orthogonal Sets, since the equality case identifies precisely when two vectors fail to have any "independent direction" between them.
Ask the tutor: Can you show me how Cauchy–Schwarz is used, step by step, to derive the triangle inequality for the induced norm?
Let be a vector space over equipped with an inner product , and let
be the induced norm. The Cauchy–Schwarz inequality states: for all ,
with equality if and only if and are linearly dependent, i.e., one of them is a scalar multiple of the other.
Intuition
Picture two vectors and in the ordinary plane. The dot product , where is the angle between them, and since , we immediately get . Cauchy–Schwarz says this bound survives even when there is no picture to draw — even in spaces of functions, matrices, or infinite sequences, where "angle" is not a primitive notion but something we are about to define using this very inequality. The proof strategy makes this precise without circularity. Drop a perpendicular from onto the line through : this gives a decomposition
where . The norm of is then the hypotenuse of a right triangle whose legs are the projection and the remainder — a Pythagorean relation — and since , the projection's length can be no larger than itself. Unwinding this single nonnegativity statement produces exactly the Cauchy–Schwarz inequality.
Central theorem
Let be a vector space over with inner product (conjugate-linear in the second slot, positive definite, conjugate-symmetric), and induced norm . Then for all :
Moreover, equality holds if and only if and are linearly dependent.
Case 1: . Then by linearity in the first slot, and , so both sides of the inequality equal and equality holds. Also is (trivially) linearly dependent with (since ), consistent with the equality-condition claim. So assume from now on that .
Step 1 (Orthogonal decomposition of along ). Define the scalar
which is well-defined since by positive-definiteness (as ). Set
Then . We claim , i.e., . Compute, using linearity of the inner product in its first argument:
Step 2 (Pythagorean expansion). Since with (hence also by conjugate symmetry), expand:
The two cross terms vanish because . Hence
Step 3 (Discard the nonnegative remainder). By positive-definiteness, . Therefore
Substitute :
Multiply both sides by :
Since (conjugate symmetry and the fact that a complex number and its conjugate have equal modulus), this is
Taking nonnegative square roots of both sides (both sides are nonnegative, and is monotonic on ) gives
which is the desired inequality.
Step 4 (Equality conditions). () Suppose linearly dependent. If , equality was shown above. Otherwise and dependence forces for some scalar (if instead with this is the symmetric case; if both sides are ). Then
so . Also , so
Equality holds. () Suppose equality holds and (the case is already linearly dependent with anything). Retracing Steps 2–3, equality forces equality at every non-strict inequality used, in particular
By positive-definiteness of the inner product, . Hence , so is a scalar multiple of : are linearly dependent.
∎Worked examples
Example 1 — asymmetric real vectors in with the standard dot product. Let and in with . Compute the inner product:
So . Compute the norms:
Then
Indeed , confirming the inequality — and strictly, since are visibly not parallel (no scalar satisfies , , simultaneously: the first gives , the second gives , contradiction). We can also extract the angle between and :
so , a well-defined obtuse angle — legitimate precisely because Cauchy–Schwarz guarantees .
Example 2 — polynomials with an inner product on . Let , polynomials of degree , with inner product
Take and (asymmetric, unrelated shapes). Compute the inner product:
Compute :
Compute :
So
Compare to . Indeed , and the inequality is strict because and are not proportional (one is degree 1, the other degree 2, so no scalar multiple of one equals the other). This numerically confirms Cauchy–Schwarz in a genuinely infinite-dimensional-flavored space (a function space), not just in .
The proof relies critically on positive-definiteness: for all , with equality only at . Drop this and the inequality can fail. Let and define the symmetric bilinear form
which satisfies bilinearity and symmetry but is not positive-definite (it is an indefinite form, the same type that appears in special-relativistic Minkowski geometry). Define purely as a formal analogue of the norm (this is not an honest norm, precisely because is not positive-definite). Take and . Then
while
so the naive right-hand side is . The claimed inequality would assert , which is false. The failure traces directly to Step 3 of the proof: the decomposition still makes sense algebraically, but can be negative, so the step "" collapses, and with it the entire chain of inequalities. This shows positive-definiteness is not a decorative hypothesis — it is exactly the load-bearing wall of the proof.
Scope, edge cases & common traps
| Situation | What happens |
|---|---|
| or | Both sides are ; equality holds trivially, consistent with linear dependence (zero vector is dependent with anything) |
| Inequality is on (modulus), since itself may be non-real | |
| Infinite-dimensional | Proof is unchanged; only uses algebra of the inner product, not dimension |
| Non-positive-definite forms | Inequality can fail entirely (see counterexample); positive-definiteness is essential |
| Real inner product, | Equality iff for some real (can further split into : same direction, or : opposite direction) |
The mathematician behind it
Origins · 1 minAugustin-Louis Cauchy and how this was discovered
Cauchy was one of the most prolific mathematicians in history, producing foundational work in real and complex analysis, the theory of permutation groups, elasticity theory, and the rigorous definition of limits and continuity that underlies modern calculus. He first proved a discrete version of the inequality that bears his name for finite sums of real numbers in 1821, in his textbook Cours d'Analyse, as a lemma supporting his study of series and inequalities. The integral form of the inequality was established later by Viktor Bunyakovsky (1859) and independently, in a broader functional-analytic setting, by Hermann Schwarz (1888); in many countries the result is accordingly called the Cauchy–Bunyakovsky–Schwarz inequality.
Does Cauchy–Schwarz require to be finite-dimensional?
No. The proof given uses only the algebraic axioms of an inner product — linearity, conjugate symmetry, and positive-definiteness — and never invokes a basis, dimension count, or coordinate representation. It therefore holds verbatim in infinite-dimensional spaces such as , the space of square-summable sequences , or spaces of continuous functions equipped with an -type inner product. This dimension-independence is part of why the inequality is so widely applicable in analysis, where infinite-dimensional function spaces are the norm rather than the exception.
Why is the proof done by projecting onto a single vector rather than using an orthonormal basis?
Projecting onto a single vector is the most economical route: it needs no basis, no Gram–Schmidt process, and no assumption about the dimension or even finiteness of . Using an orthonormal basis to prove Cauchy–Schwarz would work in finite dimensions but is circular in spirit, since orthonormal expansions are usually developed using Cauchy–Schwarz-adjacent machinery (like orthogonal projections onto subspaces), and would require extra machinery unnecessarily. The one-vector projection isolates exactly the needed inequality with minimal apparatus.
How does Cauchy–Schwarz let us define the angle between abstract vectors?
For nonzero , Cauchy–Schwarz guarantees
when the inner product is real-valued (in the complex case, one takes the real part or the modulus, depending on convention). Since cosine is a bijection from onto , there is a unique with . This is defined to be the angle between and ; without the inequality, this ratio could exceed in absolute value and no such angle would exist.
Is the complex case genuinely different from the real case?
The proof is essentially identical, but care is needed with conjugates: the inner product is conjugate-linear in one slot, and the scalar used in the projection may be a complex number. The final inequality is stated for , the complex modulus, since itself need not be real. All the algebra in the proof — the cross-term cancellation, the Pythagorean expansion — goes through with replacing , exactly as written above.
Does Cauchy–Schwarz hold for seminorms, where does not force ?
Yes, in the following weaker sense: if the form is only positive semi-definite (i.e., for all , but possibly for some ), the inequality still holds, because Step 3 of the proof only used , not strict positive-definiteness. What changes is the equality analysis: equality no longer forces linear dependence, only that the "difference vector" lies in the null space of the seminorm, which can be nontrivial.
What is the discrete version of Cauchy–Schwarz that Cauchy originally proved?
For real numbers and ,
This is exactly the abstract inequality applied to with the standard dot product , so it is a special case, not a separate result. Cauchy's original 1821 proof used a discrete algebraic identity (a special case of the Lagrange identity) rather than the projection argument, but the two proofs are secretly the same computation viewed through different lenses.
Why does the Cauchy–Schwarz inequality matter for the triangle inequality?
When expanding (in the real case, ), the cross term must be controlled to show . Cauchy–Schwarz supplies exactly the bound , which converts the expansion into , and taking square roots gives the triangle inequality. Without Cauchy–Schwarz, there is no known elementary way to control that cross term in general inner product spaces.