General Tensors and the Tensor Product
Every quantitative structure in general relativity — the metric that measures proper time, the curvature that bends light, the stress–energy that curves space — is one kind of object wearing different numbers of indices. That object is the tensor, and it is built by a single construction repeated as often as you like. Hand me the tangent space at a point, established in aq-gr-tangent-vectors-tangent-space, and its dual the cotangent space from aq-gr-cotangent-space-one-forms, and I can manufacture the entire zoo: a tensor of type is nothing more than a machine with slots that swallow covectors and slots that swallow vectors, spitting out a real number, linear in each slot on its own. Two facts make this humble definition the load-bearing wall of the whole subject. First, multilinearity means the machine is pinned down completely by what it does to the basis vectors and basis one-forms — and those answers are exactly the components you see stacked with indices in every equation. The abstract object and the index array are two views of one thing. Second, the operation that welds small machines into big ones — the tensor product — is associative and bilinear but pointedly not commutative, because slot one is not slot two. That single asymmetry is why index order carries physical meaning and why symmetrization exists at all. Get this construction right and the metric, the Riemann tensor, contraction, and general covariance are all downstream corollaries of one pointwise piece of linear algebra.
- A type- tensor at a point is a multilinear map that eats covectors and vectors and returns a real number — equivalently an element of .
- Multilinearity forces the map to be fixed by its values on basis arguments; those values are the components .
- The tensor product glues a tensor to an tensor by multiplying their outputs on separate slots, giving a tensor; it is bilinear and associative but not commutative.
- The space of tensors is itself a vector space of dimension ; in spacetime a tensor like Riemann has components before symmetry cuts it to .
- Tensors carry physical law because a genuine tensor that vanishes in one chart vanishes in all — the precise content of general covariance.
- Key idea: a type- tensor IS a multilinear map ; multilinearity means it is fixed by its values on basis arguments, and those values are the components .
Where this lives today
The tensor-product construction is not a historical formality; it is the daily working language of gravitational physics. On the right-hand side of Einstein's equation sits the stress–energy tensor, a symmetric type- object whose ten independent components in four dimensions encode energy density, momentum flux, and pressure all at once — and it is because both sides are genuine tensors that the field equation holds in every coordinate system, the operational meaning of background independence. When LIGO and Virgo matched the waveform of GW150914 in 2015 against templates, those templates were solutions of tensor equations, and the numerical-relativity codes that generate them (the BSSN and moving-puncture formulations) are engineered to evolve tensors and tensor densities correctly while the coordinate grid sloshes through the merging horizons; a code that silently treated a non-tensor as a tensor would emit coordinate-dependent garbage dressed up as gravitational waves. The same that concatenates slots here is, remarkably, the exact operation that builds the state space of a composite quantum system: the Hilbert space of two particles is the tensor product of the individual spaces, and the non-factorizable elements of that product are precisely the entangled states. This shared algebra is why the "tensor network" methods now central to condensed-matter and quantum-information research, and the multilinear machinery of general relativity, are recognisably the same mathematics — a crystallographer's word for a stretched solid now spanning quantum entanglement and the curvature of the cosmos.
The physical picture
Picture a tensor as a machine with labelled slots. A type- machine has slots on top that only accept covectors and slots below that only accept vectors. Feed the right object into every slot and a single real number falls out, and the machine is linear in each slot separately — double the input in one slot and the output doubles, holding the others fixed. Nothing else is required of it. There is no metric, no connection, no notion of length hiding inside; the machine is pure multilinear bookkeeping, assembled fresh at each point of the manifold from the tangent and cotangent spaces already sitting there. The components are simply the machine's answers on the "unit test objects." Feed in the basis one-forms where the covector slots go and the basis vectors where the vector slots go, and the numbers that come out are . Because the machine is multilinear, these numbers are everything: any other input is a weighted sum of basis inputs, and linearity reassembles the full answer from the component table. This is why an equation full of indices and a coordinate-free geometric statement are the same claim written in two alphabets.
The tensor product is the act of bolting two machines together side by side so the combined machine owns all the slots of both. Its non-commutativity is not a technicality but the whole reason index order matters: putting object in the first slot and in the second is a genuinely different arrangement from the reverse, so and are different tensors even though they are built from the same two vectors. The payoff of the entire framework is coordinate independence at the level of the object: an equation between tensors, , becomes in every chart at once, so you may prove a law in whatever frame is easiest and trust it everywhere. The second figure shows how slots concatenate under and how fast the component count grows with rank.
The core equations
The starting point is the definition itself: a type- tensor at the point is a real-valued function of covector arguments and vector arguments, linear in each argument separately. Everything downstream is an unpacking of this one line.
where: — tangent space at , the vectors; — cotangent space at , the covectors or one-forms; — contravariant rank, the number of covector slots and hence upper indices; — covariant rank, the number of vector slots and hence lower indices. Physical reading: a tensor is a linear-in-everything answer machine, defined pointwise, with no metric required. Because the tensor is multilinear, its whole content lives in what it returns on the basis arguments. Those returns are its components, and they rely on the one structural fact linking the two bases: the coordinate one-forms are dual to the coordinate vectors.
where: — coordinate basis vector of ; — coordinate basis one-form dual to it; — Kronecker delta, if else . Physical reading: probe the machine with the standard basis and record its answers — those numbers are the tensor in coordinates. Running the definition backwards, the tensor is reconstructed from its components by re-attaching the basis objects with tensor products. This expansion is the coordinate face of the geometric object.
where: the product — a basis tensor of type ; Einstein summation over each repeated index pair is implied. Physical reading: the components are the coefficients of a tensor in the basis , exactly as are the coefficients of a vector in . The simplest non-trivial tensor product welds a vector to a one-form. It produces a rank-two machine whose value on a covector and a vector is just the product of the two separate pairings — the archetype from which the general rule is read off.
where: — a vector of type , answering the covector slot; — a one-form of type , answering the vector slot; — the covector and vector arguments supplied to the new tensor. Physical reading: each factor answers its own argument and the answers multiply — slots do not talk to each other. The general tensor product obeys the same law: split the arguments between the two factors, let each factor evaluate its share, and multiply. In components this is simply the outer product of the two component arrays.
where: — a type- tensor; — a type- tensor; — the resulting type- tensor; — indices belonging to the second factor. Physical reading: is bilinear and associative but not commutative, since swapping and reassigns which object owns which slot. Counting basis tensors gives the dimension of the whole space. Each of the index positions ranges over values independently, so the component arrays fill an -dimensional vector space.
where: — dimension of the manifold, for spacetime; — the vector space of all type- tensors at . Physical reading: tensors of a fixed type add and scale like ordinary vectors, so linear algebra applies to them wholesale. Among all types, is special: one up and one down index make it a linear map from vectors to vectors, and exactly one such tensor has the same components in every chart.
where: — components of the endomorphism; — input vector; — Kronecker delta, whose two Jacobian factors cancel so it reads identically in all coordinates. Physical reading: a tensor is a coordinate-free matrix, and the identity map is the only matrix every observer agrees on.
The goal is to prove the claim on which the entire index formalism rests: that a multilinear map is fixed with no remaining freedom by the finite table of numbers it returns on basis arguments. If this failed, two distinct tensors could share every component and the index notation would be ambiguous. We show instead that multilinearity forces any input to be reconstructed from basis inputs, so the components pin the map exactly. We argue the representative case, and the pattern extends verbatim to any .
Step 1. Fix the dual bases and define the components by probing, , using . Why: the components are not extra data bolted onto the tensor — they are literally its outputs on the standard test objects, so they are guaranteed to exist and be finite.
Step 2. Expand arbitrary arguments in the bases, and , where and . Why: every covector and vector is a coordinate combination of basis elements, so no input lies outside the reach of the basis — this is what finite dimension buys us.
Step 3. Push the expansion through the map using linearity in each slot, . Why: multilinearity lets the scalar coefficients come outside, leaving only the basis evaluations — so the answer on any input is a fixed contraction of the component table.
Step 4. Conclude uniqueness. If two tensors and have for all , then for every , hence as maps. Why: equal component tables give equal outputs everywhere, so the map is determined — the array and the object are one, and the same argument with more slots settles the general case.
Go deeper · Derivation B · 1 minThe tensor product builds every higher tensor and fixes the dimension count
The goal is to show that the products of basis vectors and basis one-forms are not merely a set of tensors but a genuine basis of the whole type- space, which simultaneously proves the dimension formula and justifies writing any tensor as a sum of tensor-product terms. This is the abstract engine behind the index expansion of equation (3) and behind the universal property that characterizes as the space where multilinear maps become linear.
Step 1. Form the candidate basis, the tensors , one for each choice of the indices. Why: these are the outputs of on basis inputs, and by construction each is a legitimate type- multilinear map, so the candidate set lives in the right space.
Step 2. Show they span. Given any , define numbers and check that and the sum agree on all basis arguments; by the previous derivation they are therefore equal. Why: agreement on basis inputs is enough for equality, so every tensor is a coordinate combination of the candidate set — the set spans.
Step 3. Show they are independent. If a combination is the zero tensor, evaluate it on to read off . Why: probing with basis arguments isolates one coefficient at a time via the deltas, so the only vanishing combination is the trivial one — the set is linearly independent.
Step 4. Count. A spanning, independent set is a basis, and it has one member per assignment of indices each ranging over values, so . Why: with this yields for the metric, for Riemann, and for a tensor — the numbers used throughout this article, now derived rather than asserted.
Go deeper · Derivation C · 1 minComponents carry one Jacobian per index
The goal is to derive how the component array must change between two charts so that the geometric object stays fixed, recovering the transformation law that most textbooks promote to the very definition of a tensor. Demanding invariance of the object and substituting the chain-rule transformations of the basis factors will attach exactly one Jacobian to each contravariant index and one inverse Jacobian to each covariant index — the tensor product of the vector and one-form rules. The full machinery is owned by aq-gr-tensor-transformation-law; here we extract the law directly from the basis expansion.
Step 1. Write the same object in the chart , . Why: the tensor is basis-independent, so a coordinate change alters only the split into components times basis — track how each basis factor moves and the component rule follows.
Step 2. Substitute the basis transformations for each vector factor and for each one-form factor. Why: a basis vector is a directional derivative and drags the Jacobian ; a basis one-form is a coordinate gradient and drags the inverse — the two opposite rules are the origin of upper versus lower.
Step 3. Collect the coefficient of the new basis tensor , giving . Why: whatever multiplies the new basis is by definition the new component array, so the law reads off — one Jacobian per upper index, one inverse Jacobian per lower, matching Carroll Eq. (1.51) and Wald (2.3.6).
Step 4. Check the corollary that makes tensors carry physics: the law is linear and homogeneous in the old components, so if every in one chart, every in all charts. Why: a genuine tensor equation, once true, is true for every observer — this homogeneity is exactly the operational content of general covariance.
Limiting cases
Every familiar geometric object is a low-rank tensor; dialling selects the number and kind of slots.
| Case | Result | Meaning |
|---|---|---|
| Type — scalars | No slots: a plain number or field, invariant under any change of basis. | |
| Type — vectors | One covector slot; the tangent vectors, acting on one one-form. | |
| Type — one-forms | One vector slot; the cotangent vectors, acting on one vector. | |
| Type — bilinear forms | Two vector slots; the symmetric instance is the metric, the antisymmetric a 2-form. | |
| Type — linear maps | An endomorphism of ; the identity is the unique chart-independent one. | |
| Type — Riemann | Three vector slots and one covector slot; components, independent in . |
Worked examples
1 · Counting the components of curvature (fully numeric)
On spacetime, how many components does a general type- tensor carry with no symmetry imposed, and how does the naive count for the Riemann tensor compare with its true number of independent components?
Step 1. Apply the dimension formula . For the tensor, , so the count is . Every one of the five index slots ranges independently over the four spacetime directions, and .
Step 2. Now the Riemann tensor is type , so its naive count is . This is what the raw tensor-product basis of the second derivation delivers before any of curvature's symmetries are used.
Step 3. The symmetries — antisymmetry in the last pair, in the first pair after lowering, pair-exchange symmetry, and the first Bianchi identity — collapse this dramatically. The standard result is , which for gives . So the tensor-product construction hands us slots, of which only are physically independent in four dimensions — the rest are fixed by symmetry. The tensor-product count is the ceiling; symmetry does the carving.
2 · The tensor product of two vectors, and why order matters (fully numeric)
Work on a 2-dimensional tangent space with basis . Take and . Compute the components of the tensor , compare with , and verify the result by feeding in basis one-forms.
Step 1. By equation (5) the components are the outer product , with and . This gives , , , , i.e. the matrix .
Step 2. Now reverse the factors: gives . Comparing entry by entry, but : the two are transposes of each other and are not equal, the concrete meaning of .
Step 3. Verify against the defining action . Feed the basis one-forms and : then and , so the value is , which matches the component read off in Step 1. The machine and its array agree exactly, as the first derivation guaranteed.
3 · A (1,1) tensor as a linear map and its invariant trace (fully numeric)
On the same 2-dimensional space let a type- tensor have components . Act with it on the vector , and compute its trace as an invariant scalar. Contrast with the identity tensor.
Step 1. By equation (7) the image has components with . The first component is ; the second is . So sends , acting as an honest endomorphism of the tangent space.
Step 2. Contract the upper index against the lower to form the trace . Because this pairs one contravariant slot against one covariant slot, its single Jacobian and inverse Jacobian cancel — the trace is a genuine scalar, the same number in every chart, unlike any individual component.
Step 3. Finally the identity tensor maps every to itself and has trace here. It is the unique tensor whose components are identical in all coordinate systems, because its Jacobian and inverse-Jacobian factors cancel identically — the invariant heart of the space.
Physics of the portrait
The word "tensor" reached physics through crystals, not gravity. Long before spacetime curved, someone needed a name for a quantity that points differently in different directions inside a stressed solid — and that name, coined in the elasticity laboratories of Göttingen, is the one we now stamp on the curvature of the universe.
Origins · 1 minWoldemar Voigt and how this was discovered
Woldemar Voigt was a German physicist who spent most of his career at Göttingen studying the physics of crystals — their elasticity, their optical and thermal behaviour, and the way a single crystal responds differently along different axes. It was precisely this direction-dependence that demanded a new vocabulary. In his 1898 treatise Die fundamentalen physikalischen Eigenschaften der Krystalle, Voigt introduced the word Tensor for a physical quantity that, unlike a scalar or a simple vector, carries a whole array of directional data — the stress inside a strained crystal being the prototype. He took the name from the Latin tendere, to stretch, the same root as tension: a tensor was originally the mathematical embodiment of the stretching and shearing stresses a solid can sustain. The irony of history is that Voigt's name outgrew Voigt's subject. The multilinear algebra behind the object had already been built by Grassmann in 1844 and turned into a calculus by Ricci-Curbastro and Levi-Civita by 1900, and when Einstein needed a language in which the laws of gravitation would read the same to every observer, he adopted that calculus wholesale — and with it Voigt's word. Today the stress tensor of a crystal and the Riemann curvature tensor of spacetime are recognised as the same species of object, both type- multilinear machines, and both go by the name a crystallographer chose to describe how a solid resists being stretched.
Going further
Texts. Misner, Thorne & Wheeler, Gravitation (1973), Ch. 3 (tensors as machines with slots) · Wald, General Relativity (1984), Ch. 2 and Appendix A (the abstract tensor-product construction) · Carroll, Spacetime and Geometry (2004), Ch. 1.4–1.5 · Schutz, A First Course in General Relativity (2009), Ch. 3 · Hartle, Gravity (2003), Ch. 20. The key numerical checks are: the dimension formula yields , , and ; the Riemann independent-component count is at ; the duality relation is ; the worked outer products and are transposes of each other, and the trace of the example tensor is . All of these are exact mathematical identities — no empirical inputs appear — and the word tensor in this sense follows Voigt (1898).
Builds on: Tangent Vectors and the Tangent Space · Cotangent Space and One-Forms · Smooth Manifolds and Coordinate Charts · Atlases, Transition Functions and Differentiable Structure. Leads to: The Tensor Transformation Law · Tensor Algebra: Contraction, Symmetrization and Antisymmetrization · The Metric Tensor and the Line Element · Raising and Lowering Indices · Tensor Densities and Weights.
Ask the tutor: ask me to build any tensor you like from vectors and one-forms, evaluate it slot by slot on explicit inputs, and watch which contractions come out as chart-independent invariants.
What is the difference between a tensor and its components?
A tensor is a coordinate-free geometric object — a multilinear machine — that exists before you pick any chart. Its components are the finite table of numbers the machine returns when you feed it the basis one-forms and basis vectors of a chosen coordinate system. Change the chart and every component can change, yet the machine itself is untouched, the same way an arrow on a page is one arrow whether you measure it in inches or centimetres. The two are tied together by the fact that the components determine the tensor completely (multilinearity), so nothing is lost by working with indices — but you must remember that a component is a chart-dependent readout, not the object.
Why does the order of indices matter if the tensor product is "just multiplication"?
Because the multiplication happens on labelled slots, and the labels are part of the object. When you form , the first factor is assigned to slot one and the second to slot two, so its components are ; forming assigns them the other way, giving , which is the transpose. Numerically these differ: with and the entry is in one and in the other. The scalars multiply commutatively, but the arrangement into slots does not, and that arrangement is exactly what an index position records. Only after symmetrizing — averaging over slot orderings — may you permute indices freely.
Do I need a metric to define tensors or the tensor product?
No, and this is worth stating sharply because it is easy to assume otherwise. The tensor-product construction is purely linear-algebraic: it needs only the tangent space , its dual , and the ability to form multilinear maps, all of which exist at every point of a bare smooth manifold with no extra structure. A metric enters only later, and for a different job — it lets you raise and lower indices, identifying with and turning, say, a tensor into a or one. Without a metric those types remain genuinely distinct, but tensors and are already fully defined.
How is a (1,1) tensor a matrix, and why isn't every matrix a tensor?
A type- tensor has exactly one upper and one lower index, so its components form a square array, and its action is matrix-times-vector — it is a linear map from the tangent space to itself. But not every square array of numbers you write down is a tensor. To qualify, the array must transform correctly under a change of chart: one Jacobian on the upper index, one inverse Jacobian on the lower. A generic table of numbers, or the Christoffel symbols , or the bare partial derivative , will pick up extra inhomogeneous terms and fail the test. Wearing indices is necessary but not sufficient; obeying the transformation law is what makes a matrix a tensor.
The universal property is stated abstractly — what does it actually buy me?
The universal property says the tensor product is the unique space that turns every multilinear map into an ordinary linear map: any bilinear factors as for a single linear . Concretely, this is the guarantee that "multilinear algebra is just linear algebra on a bigger space." It is why the products form a genuine basis, why the dimension multiplies to , and why you may manipulate tensors with the full toolkit of vector spaces — add them, expand them in a basis, solve linear systems in their components. Without it, the leap from "linear in each slot separately" to "an element of one vector space with one basis" would be an assertion rather than a theorem.
Why is the Kronecker delta the only invariant (1,1) tensor?
Under a change of chart a tensor picks up one Jacobian on its upper index and one inverse Jacobian on its lower index. For the delta, by the chain rule — the two factors collapse to the identity, so its components are literally unchanged in every chart. No other array has this property: a general gets genuinely reshuffled by the Jacobians. The delta is invariant precisely because it is the identity map, and the identity is the one linear transformation every observer agrees on.
Is the tensor product the same as the outer product I learned in linear algebra?
In components, yes — that is the whole point. The outer product of two arrays, , is exactly the component form of the tensor product of the underlying geometric objects, and the Kronecker product of matrices is the same operation stacked up. What the geometric language adds is the meaning: the outer product isn't just a bookkeeping array but a genuine multilinear machine with a definite type , living in a vector space with a basis and a transformation law. So you already know how to compute if you can take outer products; the tensor formalism tells you what the result is, how it transforms, and why its slots must not be reordered casually.