Span and Linear Combinations
Suppose you are handed two vectors in . You are asked which points they can reach. This happens by scaling and adding them together. This simple question is the seed of nearly all of linear algebra. The question is: what can you build from a fixed set of vectors? The answer is a set called the span. The building process is called forming a linear combination. These two notions convert a loose collection of vectors into a precise geometric object. That object may be a point, a line, a plane, or a higher-dimensional flat subspace through the origin. The idea matters because it bridges "a list of vectors" and "a subspace." This bridge is the algebraic backbone of the entire subject. Once we know a set spans a subspace, every vector in that subspace is reachable from the set. This lets us reduce infinite questions, about all vectors in a subspace, to finite questions. Those finite questions concern only the finitely many vectors in the spanning set. This reduction is what makes coordinates, dimension, and matrix rank possible. The big picture is that span gives us the smallest subspace containing a given set. It is not an approximation, but an exact minimal enclosure. It is characterized by a clean universal property. Every subspace arises as the span of some set. Every span is a subspace. So the two ideas classify each other. This duality lets us move fluidly between two tasks. One is "generating" a subspace from a small set of vectors. The other is "testing membership" by asking whether a target vector can be written as a combination of the generators. This article gives the precise definitions of linear combination and span. It proves that span always produces a subspace. It also proves that span is the smallest subspace containing the original set. The article works through concrete numerical examples. These show how to test whether a vector lies in a span using row reduction. It closes with the natural next question: when is a spanning set efficient, with no redundant vectors? This leads directly to Linear Independence and Basis.
- A linear combination of vectors is any sum with scalars .
- The span of a set is the collection of all linear combinations of finitely many vectors from .
- is always a subspace, even when itself is not.
- is the smallest subspace containing — it sits inside every other subspace that contains .
- Testing "is ?" reduces to solving a linear system, which Gaussian Elimination and Row Reduction answers directly.
- Key idea: span turns a raw list of vectors into the exact set of everything those vectors can algebraically generate.
Where this lives today
Span is the computational core of solving linear systems: a system is consistent exactly when , connecting this article directly to everything built on Gaussian Elimination and Row Reduction. In computer graphics and robotics, the span of a set of motion or basis vectors describes all reachable configurations from a starting frame. In signal processing, the span of a finite set of basis signals (e.g., Fourier or wavelet atoms) describes exactly which signals can be synthesized from that dictionary, which underlies compression and denoising algorithms. In statistics and machine learning, the column space of a design matrix — literally the span of its columns — determines which response vectors are exactly fittable by ordinary least squares, and the orthogonal complement of that span governs the residuals. In cryptography, lattice-based schemes work with the integer span (lattice generated by) a set of vectors, where the analogous but restricted notion of "integer linear combinations" replaces the full field-scalar span used here. Physics uses span constantly: the state space of a quantum system is spanned by basis states, and any physical state is, by the superposition principle, a linear combination of basis states — an idea that is span in a complex vector space with an added inner-product structure.
Ask the tutor: How do I find the smallest spanning set for a given subspace, and how does that connect to linear independence?
Let be a vector space over a field , and let be a finite list of vectors. A linear combination of is any vector of the form
The scalars are called the coefficients of the combination. Now let be an arbitrary subset (possibly infinite, possibly empty). The span of , written , is the set of all linear combinations of finitely many vectors chosen from :
By convention, the empty linear combination () is the zero vector, so
If , we say spans , or is a spanning set for .
Intuition
Picture two vectors and in the plane that do not lie on a common line through the origin. A linear combination lets you slide independently along the direction of and along the direction of , and add the results. Because you may choose any real coefficients, including negative and fractional ones, you can reach every point in the plane this way. The span of is therefore all of . If instead happens to be a scalar multiple of (they lie on the same line), then no matter how you choose and , the combination is still just a multiple of . The span collapses from a plane down to a single line. This is the first hint of redundancy in a spanning set — a theme that becomes the definition of Linear Independence. Span is best understood through two complementary lenses. Geometrically, is the smallest "flat" (line, plane, or higher-dimensional analogue) through the origin that contains every vector of . Algebraically, is exactly the solution set of the membership question "can be written using only vectors from ?" — and this question is answered mechanically by setting up a linear system and row reducing.
Let be a vector space over a field , and let be any subset. Then:
(a) is a subspace of .
(b) .
(c) If is any subspace of with , then . Consequently, is the smallest subspace of containing : it equals the intersection of all subspaces of that contain .
We prove (a), (b), (c) in turn, using the subspace criterion (a nonempty subset closed under addition and scalar multiplication, or equivalently containing and closed under these operations) established when Subspaces were introduced.
Proof of (a): is a subspace. Nonempty / contains . By definition, the empty linear combination (with terms) equals , and it is counted as an element of regardless of what is. Hence , so . Closed under addition. Let . By definition there exist finitely many vectors and scalars with
and finitely many vectors and scalars with
Then
is again a linear combination of finitely many () vectors drawn from (the lists and need not be disjoint; repeats are allowed and cause no issue, since a repeated vector's coefficients simply add). Hence . Closed under scalar multiplication. Let as above, and let . Then
is again a linear combination of finitely many vectors from , so . By the subspace criterion, is a subspace of . This proves (a).
Proof of (b): . Let . Then is a linear combination of the single vector (take , ). Hence . Since was arbitrary, .
Proof of (c): minimality. Let be any subspace of with . We must show every element of lies in . Let , so
for some finite list and scalars . Since , each . Since is a subspace, it is closed under scalar multiplication, so for each . Since is a subspace, it is also closed under addition; applying this repeatedly (a finite induction on ) gives
Explicitly: the case gives since every subspace contains . For the inductive step, if , then adding the further element keeps the sum in by closure under addition. Hence . Since was arbitrary, . This proves (c).
Consequence: span equals the intersection of all subspaces containing . Let denote the family of all subspaces of that contain , and let . (This family is nonempty because itself is a subspace containing , so the intersection is well-defined.) By part (a), is a subspace, and by part (b), ; hence , which gives (since is the intersection of all members of , including itself). Conversely, for every we have with a subspace, so part (c) gives . Since this holds for every , we get . Combining both inclusions, , i.e., equals the intersection of all subspaces of containing . Since an arbitrary intersection of subspaces is itself the largest set contained in every one of them, this exhibits concretely as the smallest subspace containing , completing the proof.
∎For any subset of a vector space ,
By the theorem, is itself a subspace containing . Applying part (c) of the theorem with (which contains ) shows trivially, but more usefully we apply part (c) with the set being itself and the ambient subspace being : since is a subspace containing , minimality (part (c) applied to the set ) gives . The reverse inclusion is part (b) applied to the set . Hence equality holds.
∎Worked examples
Example 1 — Deciding membership in a span via row reduction (asymmetric numeric case). Let and consider
Question: is in ? We need scalars with . This is the linear system with augmented matrix
Row reduce. and :
and :
gives pivot row . Then :
The last row reads , an impossible equation. The system is inconsistent, so no such exist.
Conclusion: . Geometrically, span (at most) a 3-dimensional subspace of , and simply does not lie in it — the row reduction detects this via the inconsistent last row, exactly the mechanism developed in Gaussian Elimination and Row Reduction.
Example 2 — Finding the span of a small set as an implicit equation, then confirming a vector's coefficients. Let and let
Since are not parallel (no scalar satisfies , as the first coordinates would force but the second coordinates would then force ), their span is a genuine plane through the origin in , not a line.
Step 1: find the implicit (Cartesian) equation of the plane. A vector lies in iff there exist with
This gives , , and . From the second equation, . Substitute into the first: , so . Substitute both into the third equation as a consistency check:
So
(Sanity check: plug in : . ✓. Plug in : . ✓.)
Step 2: test a specific vector and recover explicit coefficients. Let . Check the equation first: , so — no further work needed. Now try : . Still not in the span. Try : . So ; find its coefficients using and . Check:
This example shows two complementary tools: an implicit linear equation cutting out when is small relative to the ambient dimension, and the direct coefficient-solving method used in Example 1 for testing membership.
The definition of span requires each individual linear combination to use only finitely many vectors, even when itself is infinite. Suppose we relaxed this and allowed "infinite linear combinations" (infinite sums) without any topological structure to make sense of convergence. Let , the vector space of all polynomials with real coefficients (a genuine vector space with no addition operation beyond finite sums built into its definition), and let
With the correct (finite-combination) definition, is exactly the set of polynomials — every polynomial is, by definition, a finite sum , so , consistent with the theorem. Now imagine dropping finiteness and allowing formal infinite sums . This object is a formal power series, not a polynomial, and it does not belong to at all (for instance has no finite degree and is not a polynomial). Allowing such combinations would produce a strictly larger set that is not even a subset of , breaking the very first conclusion of the theorem — that automatically, since it is built only from operations already available in . This shows the finiteness clause in the definition is not a cosmetic restriction: without it, "span" stops being computable from the vector space's own addition operation (which is only ever defined for finitely many summands) and can leave the space entirely. The hypothesis " finite for every combination" is what guarantees is built purely from operations already provides, which is exactly what part (a) of the theorem relies on.
Scope, edge cases & common traps
| Situation | What to remember |
|---|---|
| , the zero subspace — not the empty set. | |
| or | Including the zero vector never enlarges the span beyond what the nonzero vectors already give: . |
| infinite | Span is still well-defined: it is the union of spans of all finite subsets of . Each individual combination still uses finitely many vectors. |
| already a subspace | Then , since is closed under the operations that build linear combinations, and minimality (part (c) with ) forces equality. |
| Testing | Always reduces to solving a linear system where columns of are the vectors in ; consistency of the system is the entire question. |
The mathematician behind it
Origins · 1 minHermann Günther Grassmann and how this was discovered
Grassmann was a schoolteacher and linguist in Stettin (then Prussia) who, largely outside the academic mathematical establishment, developed a general theory of "extensive quantities" in his 1844 treatise Die lineale Ausdehnungslehre. He worked with what we would now recognize as linear combinations, spans, and linear independence in arbitrary dimensions — decades before these ideas were standard, and in a highly abstract, algebraic style that his contemporaries found difficult to parse. His work anticipated much of the vector space formalism used today, including the notion that a set of "units" generates a space by all possible linear combinations of them.
Is the zero vector always in the span of any set ?
Yes. By the definition given here, the "empty linear combination" (using zero of the vectors in , i.e. ) is defined to equal , and this combination is always available regardless of what contains. So for every subset , including . This is consistent with the theorem: must be a subspace, and every subspace contains by definition. Including or excluding from itself never changes the span, since for any already contributes nothing new to the set of reachable combinations.
Does span depend on the order in which vectors are listed?
No. The span of a set depends only on which vectors belong to , not on any ordering or listing of them. Linear combinations are sums, and vector addition is commutative and associative in every vector space, so permuting the order of the summands never changes the resulting vector. Consequently always. What does matter is which vectors are included (adding a genuinely new direction can enlarge the span) and how many times a vector's direction is represented (though duplicating a vector in the list changes nothing, since only cares about the set , not a list with repeats).
Can a span ever fail to be a subspace?
No — this is precisely what the theorem proves: is always a subspace of , for every subset , with no extra hypotheses needed on . This is one of the most useful facts in the subject, because it means you never need to separately check the subspace axioms (containing , closure under addition, closure under scalar multiplication) for a set that has been described as a span — those three properties are guaranteed automatically by the construction. This is exactly why "span of a finite list of vectors" is the standard way to manufacture new subspaces in examples and proofs.
If spans , must be finite?
No. A vector space can be spanned by an infinite set without possessing a finite spanning set — such spaces are called infinite-dimensional. The space of all polynomials is spanned by the infinite set , but no finite subset of polynomials can span all of , since any finite set of polynomials has a maximum degree , and no combination of them can produce a polynomial of degree greater than . Whether a vector space admits a finite spanning set is exactly the distinction between finite-dimensional and infinite-dimensional vector spaces, a topic developed further once Basis is introduced.
How is span related to the solution set of a homogeneous linear system?
They are dual perspectives on subspaces. A span is described constructively: you build every element by explicitly combining given generating vectors. A homogeneous system's solution set is described implicitly: you specify constraints that a vector must satisfy, without listing generators. Both descriptions produce subspaces, and converting between them is a standard row-reduction task: given implicit equations, row reduction produces explicit generating (spanning) vectors for the solution space, and conversely, given a spanning set, elimination can produce the implicit equations cutting out that span (as done in Example 2 above).
Why does the definition require the combination to use only finitely many vectors from , even if is infinite?
Because a general vector space only comes equipped with a binary addition operation, which extends unambiguously to any finite sum by repeated application, but not to an infinite sum without extra structure (a topology, a norm, a notion of convergence). Requiring finiteness in each individual combination guarantees that is built purely from the algebraic operations already has, so it is automatically a subset of and automatically closed under those operations — this is exactly what makes the "span is a subspace" theorem true with no further hypotheses. The Vector Space counterexample above shows what breaks if this finiteness requirement is dropped.
Is for a single nonzero vector always a line through the origin?
Yes, when the field of scalars is (or any infinite field) and . In that case is exactly the one-dimensional line through the origin in the direction of , since scaling by every real number sweeps out that entire line and nothing else (no combination of a single vector can leave the line it generates). If , then , a single point, not a line — this matches the general fact that including the zero vector never changes a span. Over a finite field the "line" instead consists of finitely many points, one for each scalar.