Invertible Matrices
Can a matrix have a left inverse but no right inverse? This question sits at the heart of understanding square matrices. In infinite-dimensional settings the answer is yes. A shift operator can have a one-sided inverse without having a two-sided one. But in finite dimensions something remarkable happens. For square matrices, one-sidedness collapses. A single equation forces as well. This asymmetry between the finite and infinite worlds is not a technicality. It is a load-bearing fact used constantly, often without comment, throughout linear algebra. Invertible matrices matter because they are exactly the matrices representing bijective linear maps. These are the algebraic shadows of coordinate changes, symmetries, and reversible processes. Solving uniquely for every depends on this. So does changing basis, defining determinants and eigenvalues, and building the machinery of Rank of a Matrix. All of these lean on a precise understanding of what invertibility means and how to detect it. The set of invertible matrices also carries its own rich structure. It forms a group, the general linear group , under matrix multiplication. This group is the algebraic home for symmetry itself. The big picture is this: invertibility of a square matrix is a single yes/no condition. It is equivalent to a long list of others. These include nonzero determinant, full rank, trivial kernel, columns forming a basis, and more. This article isolates the cleanest version of this equivalence. It proves the deep one-sided fact rigorously, using only Matrix Multiplication as Composition and known facts about linear maps on finite-dimensional spaces. It also shows exactly where the finite-dimensionality hypothesis is used, and what breaks without it. By the end you will have a complete proof of several key facts. For square matrices over a field, injectivity, surjectivity, and bijectivity of the associated linear map are all equivalent. A one-sided inverse is automatically two-sided. The invertible matrices form a group. We also preview how row reduction (Elementary Matrices and Row Operations) gives a computational test for invertibility.
- A square matrix is invertible if there exists with ; such is unique and written .
- In finite dimensions, a one-sided inverse of a square matrix is automatically a two-sided inverse — this fails in infinite dimensions.
- Invertibility of is equivalent to: , , columns (or rows) form a basis, and the map is injective (equivalently surjective).
- The invertible matrices over a field form a group under multiplication, generally non-abelian for .
- whenever and are invertible — order reverses, exactly as for composing invertible functions.
- Key idea: invertibility of a square matrix is a rigid, all-or-nothing property fully witnessed by either side of the inverse equation, thanks to finite dimensionality.
Where this lives today
Invertible matrices are the algebraic backbone of change of basis: passing between coordinate systems in a vector space requires an invertible transition matrix, used throughout diagonalization and canonical form theory. In differential equations and dynamical systems, the invertibility of the flow map (or of a linear system's coefficient matrix) governs whether trajectories can be uniquely reversed in time. In cryptography, invertible matrices over finite fields (e.g., ) underlie linear codes and classical cipher constructions such as the Hill cipher, where decryption literally requires computing . In computer graphics and robotics, invertible matrices represent reversible geometric transformations (rotations, scalings, shears), and together with its subgroups (like , ) parametrizes the symmetries used in rendering pipelines and kinematics. In statistics, invertibility of the design matrix's Gram matrix is precisely the condition for a unique least-squares solution in linear regression. In quantum mechanics, invertible (indeed unitary) matrices represent reversible time evolution of finite-dimensional quantum states.
Ask the tutor: Why exactly does the finite-dimensionality of break down for the shift operator example, and where precisely in the Rank–Nullity proof does that assumption get used?
Let be a field and let be a square matrix. Say is invertible (or nonsingular) if there exists a matrix such that
where is the identity matrix. If such exists it is called the inverse of and denoted . A matrix that is not invertible is called singular. The set of all invertible matrices over is denoted
called the general linear group of degree over .
Intuition
Think of a square matrix as encoding a linear map , , in a fixed basis (see Matrix Multiplication as Composition). Composition of linear maps corresponds to matrix multiplication, and the identity map corresponds to . So " is invertible" means exactly " is an invertible function," i.e., has a two-sided inverse function. The content of this article is that for square matrices on a finite-dimensional space, checking only one direction of invertibility — say that is injective — is already enough to conclude the whole story: is bijective, and the inverse map is also linear, hence represented by an honest inverse matrix . Picture as a rigid frame of independent directions (a basis). Applying moves this frame to the frame given by the columns of . If those images stay independent (never collapsing into a lower-dimensional subspace), the map cannot lose information, so it must also be onto: there's no "room" left over in an -dimensional target for the image of an -dimensional domain to be a proper subspace and still capture everything only if it fails to be injective. This finite counting argument — dimension in equals dimension out — is the engine behind the one-sided-inverse theorem.
Let be a field, let be an integer, and let . Suppose there exists such that
Then is invertible, and in fact as well, so . Equivalently (dually): if there exists with , then also and . Consequently, for a square matrix over , the following are equivalent: 1. is invertible (has a two-sided inverse). 2. There exists with (a left inverse). 3. There exists with (a right inverse). 4. The linear map , , is injective. 5. The linear map is surjective. 6. The columns of form a basis of .
Let be a finite-dimensional vector space with , and let be linear. Then
Consequently is injective if and only if is surjective.
This is the Rank–Nullity Theorem applied with domain and codomain both equal to ; we use it as a known prerequisite result about linear maps on finite-dimensional spaces (see Invertibility of Linear Maps). Injective surjective. If is injective, , so . By Rank–Nullity, . Since is a subspace of with the same finite dimension as , we have (a subspace of a finite-dimensional space that has the full dimension must be the whole space, since any basis of the subspace is a linearly independent set of size in and hence a basis of ). Thus is surjective. Surjective injective. If is surjective, , so . By Rank–Nullity, , so , which means is injective (linear maps with trivial kernel are injective: if then , so , so ).
∎Proof of the main theorem. We prove the chain , and separately establish 's equivalence, which will make all six statements equivalent, and along the way we extract the two one-sided-inverse claims. Throughout, identify with the linear map , ; matrix multiplication corresponds to composition of these linear maps, and corresponds to the identity map (this correspondence is Matrix Multiplication as Composition, assumed known).
Step 1: . Suppose . Let be the associated linear maps; then . Suppose for some . Apply to both sides:
Hence is injective.
Step 2: . This is exactly the Lemma above, applied with (finite-dimensional, ) and .
Step 3: . Suppose is surjective. We construct a right inverse matrix . Let be the standard basis of . Since is surjective, for each there exists with . Let be the matrix whose -th column is . By the column interpretation of matrix multiplication, the -th column of is . Since this holds for every , .
Step 4: . This is the substantive step and the core of the theorem — we must upgrade a right inverse to a full two-sided inverse. Suppose . First, apply Steps 1–3 to the matrix in place of : from we read this as " is a left inverse of ," i.e. satisfies condition (2) with the roles of replaced by (that is, plays the role of "" with , ). By Steps 1–2 applied to , the map is injective, hence (by the Lemma) surjective, hence by Step 3 there exists with . Now we show . We have
Here we used associativity of matrix multiplication (which reflects associativity of function composition) and the hypothesis . So , and therefore becomes . Combining (given) with (just shown), is a genuine two-sided inverse of . Hence is invertible, i.e. condition (1) holds, with .
Step 5: . Trivial: if is invertible with inverse , then satisfies . This closes the cycle , so all of (1), (2), (3), (4), (5) are equivalent.
Recovering the one-sided statements. Suppose . By (the chain just proved), is invertible with some two-sided inverse . Then
so , and in particular . This proves the first displayed claim of the theorem. The dual claim (right inverse implies two-sided) is exactly Step 4 above, verbatim.
Step 6: . Suppose is invertible. If for scalars , i.e. where , apply : . So the columns are linearly independent; being independent vectors in the -dimensional space , they form a basis (a linearly independent set of size in a finite-dimensional space is automatically a basis, since it must also span: otherwise it could be extended to a larger independent set, contradicting that any independent set has size at most ). Conversely, if the columns of form a basis of , then for every there are unique scalars expressing as their combination, i.e. has a solution for every ; this says is surjective, and by the already-established equivalence, is invertible. All six conditions are therefore equivalent, and the two one-sided-inverse claims are established.
∎Let be a field. The set of invertible matrices over , equipped with matrix multiplication, is a group: it is closed under multiplication, contains the identity , multiplication is associative, and every element has an inverse in .
Associativity holds for all matrices, invertible or not, hence in particular in (matrix multiplication is always associative, inherited from associativity of function composition, Matrix Multiplication as Composition). Identity. since , so is its own inverse. Inverses. By definition, if then exists with ; this same equation read with the roles of and swapped shows is invertible with inverse , so . Closure. Let . We claim , which in particular shows . Compute, using associativity:
So is a two-sided inverse of ; by uniqueness of inverses (if is invertible, its inverse is unique: if and then ), and . All group axioms hold, so is a group under matrix multiplication.
∎Worked examples
Example 1: Verifying invertibility via a genuine one-sided check. Let
We test invertibility by checking injectivity of directly — i.e., showing — which by the theorem suffices, with no need to separately verify surjectivity or exhibit a two-sided inverse up front. Suppose :
From the first equation, . Substitute into the third: , so . Substitute both into the second: , which gives — no new information, and the system is consistent for any . Set : then , . Substitute back into the original equations to double check: first equation ✓; third equation ✓; second: ✓. So every choice of gives a solution . Taking gives the nonzero vector with . Hence , so is not injective. By the theorem, is not invertible — no right or left inverse can exist, without our needing to search for one. As a cross-check via determinant (previewing Rank of a Matrix and cofactor expansion):
confirming singularity independently.
Example 2: Exhibiting a one-sided inverse and getting the other side for free. Let
Compute directly:
So : is a left inverse of . By the theorem's one-sided-inverse claim, is automatically invertible and as well, with . We verify this directly rather than taking it on faith:
Indeed too, exactly as the theorem predicted — checking one side was already conclusive, and the arithmetic above is the concrete instance of the general argument in Step 4 of the proof ( type identity, here with ).
Drop the hypothesis that the space is finite-dimensional and one-sided inverses can genuinely fail to be two-sided. Let , the space of all sequences of elements of a field (an infinite-dimensional vector space). Define the right shift and left shift by
Both are linear. Compute the composition :
so : here is a left inverse of (equivalently is a right inverse of ). But the other composition:
in general — for instance with and all other entries , fixes the sequence but sends it to . So . Thus has a left inverse () but itself has no right inverse making it two-sided invertible: is injective but not surjective (nothing maps to under since every output of has first coordinate ), and is surjective but not injective (its kernel contains all sequences of the form ). This is exactly the failure mode the finite-dimensional theorem rules out: injectivity and surjectivity split apart once is infinite-dimensional, because the Rank–Nullity dimension count that forced them together no longer applies. The hypothesis " is a square matrix acting on the finite-dimensional space " is therefore not a technicality — it is precisely what makes the one-sided-inverse theorem true.
Scope, edge cases & common traps
| Situation | What happens | Why |
|---|---|---|
| square, finite-dim. | One-sided inverse two-sided | Rank–Nullity forces injective surjective |
| non-square (, ) | One-sided inverses can exist without the other side | Domain/codomain dimensions differ; no contradiction from Rank–Nullity |
| Infinite-dimensional | One-sided inverses need not be two-sided | Shift operators; see counterexample |
| not a field but a general ring | Theorem can fail | Rank–Nullity and basis arguments use field structure (division by nonzero scalars) |
| singular, no inverse of either kind | Equivalent condition (6): columns dependent |
The mathematician behind it
Origins · 1 minArthur Cayley and how this was discovered
Arthur Cayley, a British mathematician and one of the most prolific algebraists of the nineteenth century, is credited with founding matrix theory as an independent algebraic subject. Working initially as a lawyer to support himself before securing an academic post at Cambridge, Cayley treated matrices as objects to be added and multiplied in their own right, rather than mere arrays of coefficients for a linear system. His 1858 memoir on the theory of matrices introduced matrix multiplication, the identity matrix, and — crucially for this article — the notion of a matrix inverse, alongside an early version of what is now called the Cayley–Hamilton theorem.
Does a square matrix need both and checked to confirm invertibility?
No — this is the central point of this article. For a square matrix over a field acting on a finite-dimensional space, if you find any with or any with , that single equation already forces to be invertible with , and the other equation follows automatically. The proof runs through Rank–Nullity: one-sided inverse gives injectivity or surjectivity of , and on a finite-dimensional space these two properties are equivalent for maps from a space to itself, so bijectivity — and hence full invertibility — comes for free.
Why does this one-sided shortcut fail for non-square matrices?
Because Rank–Nullity in that setting reads where is the dimension of the domain, while the codomain may have a different dimension . If , injectivity and surjectivity are no longer forced to coincide — an matrix with can be injective without being surjective (its image is a proper subspace of the larger codomain), and one with can be surjective without injective. One-sided inverses for rectangular matrices exist in different senses (left vs. right pseudo-inverses) but are genuinely different objects.
Is abelian?
Only when (or in degenerate cases like having very few elements combined with small , but generically no). For , matrix multiplication is non-commutative: for instance swapping rows via one elementary matrix then scaling via another gives a different result depending on order. So is a genuinely non-abelian group for , which is part of why it plays such a rich role as a source of examples in group theory and representation theory.
How does the determinant relate to this theorem?
The determinant gives a single-number test: is invertible if and only if . This is consistent with, and can be derived alongside, the equivalences in the theorem — e.g., columns of form a basis if and only if they are linearly independent if and only if . The determinant is often the fastest hand-computation route to check invertibility for small matrices, while the injective/surjective formulation is the conceptual reason the determinant test works at all.
Does the theorem hold over rings that are not fields, like ?
Not in general, and the argument used here relies on field-specific facts, particularly the basis-extension and Rank–Nullity arguments valid for vector spaces over a field. Over , for instance, invertibility as a matrix over additionally requires (not merely nonzero), because you need to lie back in . The general theory of modules over rings replaces "basis" with more delicate notions (free modules, torsion), and one-sided invertibility results become subtler.
If and are both invertible matrices, is necessarily invertible?
No. Invertibility is not preserved under addition. For example, with and , both are invertible, but , the zero matrix, which is singular (it sends every vector to , so it is not injective for ). Invertibility is a multiplicative property, tied to the group structure of , and there is no reason to expect it to survive under the unrelated operation of addition.
What is the fastest way in practice to test if a matrix is invertible?
Row reduce to row echelon form using elementary row operations (see Elementary Matrices and Row Operations); is invertible exactly when this process produces nonzero pivot rows, equivalently when the reduced row echelon form is . This is computationally the standard method, and it simultaneously computes if you augment with the identity matrix and row-reduce the pair to .