Sample Spaces and Events
Suppose you toss a coin three times and ask: what is the chance of getting more heads than tails? Before any number can be attached to this question, we must first pin down some things with total precision. We must define what the possible outcomes even are. We must also define what it means to "get more heads than tails" as a mathematical object. This is the quiet, foundational work that makes all of probability theory possible. It translates a vague experiment into a precise universe of outcomes. It also translates a vague event description into a subset of that universe. This translation matters because probability is, at its core, a theory of measurement on sets. Once an experiment is encoded as a sample space, events are encoded as subsets of it. Then the entire machinery of set theory becomes available. This includes unions, intersections, complements, and De Morgan's laws. These tools let us reason about combinations of events: "heads on the first toss or fewer than two heads total," "not both A and B," "at least one of three events." Without this encoding, such compound statements would be linguistic puzzles. With it, they become algebra. The big picture is this: probability theory sits on top of two ingredients. These are a set of outcomes and a rule for assigning numbers (probabilities). This rule assigns numbers to certain subsets of that set. This article is entirely about the first ingredient and its bookkeeping. It covers outcomes, sample spaces, events, and the algebra of events. It deliberately postpones the question of how numbers get assigned. That question belongs to The Axioms of Probability. Here, the goal is to make the set-theoretic scaffolding airtight. Every later theorem about probability inherits any looseness left at this stage. By the end of this article you will be able to do several things. You will construct sample spaces for finite, countable, and continuous experiments. You will express complex verbal event descriptions as precise set expressions. You will manipulate events correctly using union, intersection, complement, and set difference. You will recognize mutually exclusive and exhaustive events. You will also prove and apply De Morgan's laws for events. These laws are indispensable in every computation that follows in Combinatorial Probability.
- A sample space is the set of all possible outcomes of an experiment; each outcome is mutually exclusive with every other.
- An event is any subset ; it "occurs" exactly when the realized outcome lies in .
- Set operations translate verbal logic directly: "or" is union, "and" is intersection, "not" is complement.
- Two events are mutually exclusive (disjoint) if ; they cannot both occur on the same trial.
- De Morgan's laws — and — let you rewrite "not (this or that)" and "not (this and that)" correctly, avoiding a classic reasoning error.
- Key idea: encoding an experiment as a set and events as subsets of turns probability into set algebra, the load-bearing structure for everything that follows.
Where this lives today
The sample-space/event formalism is the universal starting point of every quantitative field touching uncertainty. In statistics, hypothesis tests and confidence intervals are built by specifying the sample space of possible data and defining rejection regions as events. In statistical mechanics (physics), the "microstates" of a system form a sample space, and macroscopic observables correspond to events (unions of microstates with a shared property), directly paralleling the coin/spinner constructions here. In computer science, randomized algorithms and average-case analysis model all possible random choices (coin flips, hash collisions) as a sample space, with "algorithm fails" or "collision occurs" as events whose probability is bounded. In cryptography, security proofs model an adversary's random coins and the key-generation randomness as part of a sample space, and security is phrased as a bound on the probability of the "adversary wins" event. In actuarial science and finance, the space of possible future economic scenarios is the sample space, and claims, defaults, or losses are modeled as events, forming the basis for risk pricing built later on Random Variables defined on that same space. In quantum information, event algebras generalize to projections on Hilbert spaces, but the classical Boolean event algebra developed here is the base case that motivates the generalization.
Ask the tutor: How does the choice of sample space (ordered vs. unordered outcomes) affect probability calculations in a sampling-without-replacement problem?
Let an experiment be any procedure with an uncertain result that can nonetheless be described by listing its possible results in advance. The sample space of an experiment is the set of all possible outcomes of the experiment, subject to two requirements: 1. Exhaustiveness: every possible result of the experiment corresponds to exactly one element of . 2. Mutual exclusivity of outcomes: the elements of are pairwise distinct — on any single performance of the experiment, exactly one is realized. An element is called an outcome (or sample point, or elementary event). An event is any subset (for uncountable , one restricts to a suitable class of "measurable" subsets, but for finite or countable every subset qualifies). The event is said to occur on a given performance of the experiment, with realized outcome , if and only if . Two special events are always available: the certain event itself (which always occurs) and the impossible event (which never occurs).
Intuition
Think of as a complete, non-overlapping partition of "everything that could happen" into indivisible atoms, the outcomes. An event is simply a region of this space — a collection of atoms grouped together because they share some property of interest. The event "the die shows an even number" is not itself an outcome; it is the set , a union of three outcomes. This shift — from asking "what happened?" (an outcome) to asking "did property happen?" (an event, a set) — is exactly what lets us combine properties using the Boolean connectives and, or, not, which correspond precisely to , , and complementation. Once events are sets, compound statements translate mechanically. " or occurs" means the realized outcome lies in . " and both occur" means it lies in . " does not occur" means it lies in . Venn diagrams make these translations visually obvious, but the power of the framework is that it also works flawlessly for sample spaces too large or too abstract to draw, such as the space of all infinite sequences of coin flips.
The mathematician behind it — placeholder note
(Section continues below in required order.)
Let be a sample space and let be events. Then:
where denotes the complement of relative to . More generally, for any index set (possibly infinite) and events ,
We prove the general infinite-index version; the two-event case is the special case .
Technique: double inclusion (mutual subset containment) via the definitions of complement, union, and intersection as sets of outcomes satisfying quantified conditions. This is a purely set-theoretic argument and uses no probability axiom, so it cannot be circular with respect to anything in The Axioms of Probability.
Part 1: . () Let . By definition of complement, and . By definition of union, "" means "there exists with ." Negating this existential statement gives: "for all , ." For each such , since and , we have . As this holds for every , by definition of intersection . () Let . By definition of intersection, for every , i.e. and for every . Hence the statement "there exists with " is false, i.e. . Combined with , this gives . Both inclusions hold, so the two sets are equal, proving Part 1.
Part 2: . Apply Part 1 to the events in place of , using the involution property for any (immediate from the definition of relative complement, since , using throughout). Part 1 with replaced by gives
Taking complements of both sides (and using involution again on the left) yields
which is Part 2.
∎For events : " or does not occur" is equivalent to " does not occur and does not occur," and "not both and occur" is equivalent to " does not occur or does not occur." This is immediate from the Theorem with .
Worked examples
Example 1 — A biased spinner with three unequal regions, plus a fair coin. An experiment consists of two stages: (i) spin a pointer on a disk divided into three unequal regions labeled (red), (green), (blue), and record which region it stops in; (ii) independently flip a fair coin and record Heads () or Tails (). We are asked to build the sample space and express three events as subsets. Step 1: Construct . Each performance of the experiment produces an ordered pair (spinner result, coin result). Since the spinner has 3 outcomes and the coin has 2, and every combination is a genuinely distinct, exhaustive, mutually exclusive possibility, the sample space is the Cartesian product
Listing carefully (six elements, ):
Each of these six symbols is one outcome — an atom of the sample space. Step 2: Verify the sample space axioms. Exhaustiveness holds: every possible joint result is one of these six pairs, since the spinner must land in exactly one of and the coin must show exactly one of . Mutual exclusivity holds: no performance of the experiment can simultaneously realize two different pairs, e.g. it cannot be both and at once. Step 3: Translate three events into subsets.
- = "the spinner lands on red." As a subset of : , since these are precisely the outcomes whose first coordinate is .
- = "the coin shows heads." Then .
- = "the spinner does not land on blue, or the coin shows tails." Parsing carefully: "spinner not blue" is the event ; "coin shows tails" is ; the word "or" means union. So
Note : it is the only outcome excluded, since it is the only one where the spinner is blue and the coin is not tails — check: is ? Spinner is blue (fails "not blue"), coin is heads (fails "tails"), so both disjuncts fail, hence , confirming . Step 4: Compute and interpret. . In words: "spinner red and coin heads" happens only via the single outcome , which matches intuition directly. Step 5: Compute via De Morgan and verify by direct listing. First , so . Now via De Morgan's Laws (proved above): , and . Then
This matches exactly, confirming the theorem numerically in this instance.
Example 2 — Sampling without replacement from an urn, with a subtle event description. An urn contains 4 balls labeled ; balls are red and balls are blue. Two balls are drawn without replacement and without regard to order (i.e., we record only the unordered pair drawn, not which was drawn first). Step 1: Construct . Since order is not recorded, an outcome is an unordered pair of distinct labels from . There are such pairs:
Each is genuinely one outcome (mutual exclusivity: the drawn pair cannot simultaneously be and ; exhaustiveness: every possible draw is one of these six pairs). Step 2: Define events.
- = "both balls drawn are the same color." Checking each pair against colors ( red; blue): same color (red-red) ✓; mixed ✗; mixed ✗; mixed ✗; mixed ✗; same color (blue-blue) ✓. So
- = "ball 1 is drawn." The pairs containing label 1 are , so .
- = "at least one red ball is drawn." A pair fails to contain a red ball only if both its elements are blue, i.e. only for . So , a set of size 5.
Step 3: A compound event and mutual exclusivity check. Consider : pairs that are same-color and contain ball 1. From , only contains ball 1 (since does not). So , a single outcome — both balls red, and specifically ball 1 is one of them. Step 4: Are and mutually exclusive? (complement of found in Step 2, size ). Is ? We have and , so . They are not mutually exclusive — indeed (no red ball drawn) is simultaneously an instance of "same color" and "no red ball," which makes sense since two blue balls are automatically same-colored. Step 5: Apply De Morgan explicitly. Compute . First, (every pair is listed once we include from and the rest from ). So . Checking via De Morgan: and ; then , matching exactly.
Drop the mutual exclusivity of outcomes requirement in the definition of a sample space, and let outcomes be allowed to overlap as sets. Consider rolling a single fair die, but suppose someone (incorrectly) proposes the outcome list
as the sample space, intending these three labels as the "outcomes." This fails badly. The labels "even" and "greater than 4" are not mutually exclusive: rolling a 6 makes both true simultaneously, so it is impossible to say the experiment "resulted in" a single, unambiguous element of . Rolling a 6 does not correspond to exactly one point of ; it corresponds to two ("even" and "greater than 4" both hold), while rolling a 5 corresponds to a different two ("odd" and "greater than 4"). Consequently the entire event/subset formalism collapses: the event was supposed to represent "the die shows an even number," but since "even" and "greater than 4" can occur together, treating them as distinct atomic outcomes double-counts the roll of across two different "elementary events." Any later probability assignment (say, via counting outcomes) built on would be internally inconsistent — for instance, naive equally-likely counting would assign probability to each of the three labels, summing to , even though a single roll of 6 makes two of the three labels simultaneously true, which is incoherent for a partition-based model. The correct sample space is , in which every outcome is a single face value, genuinely mutually exclusive from every other, and the properties "even," "odd," "greater than 4" are then correctly recovered as the events (subsets) , , respectively — sets that are allowed to overlap, because events, unlike outcomes, need not be disjoint. This is exactly why the definition insists mutual exclusivity is a property of outcomes, not of events.
Scope, edge cases & common traps
| Situation | Correct treatment | Common trap |
|---|---|---|
| Continuous experiment (e.g. a dart hitting ) | ; only a suitable class of subsets (Borel sets) are treated as events | Assuming every subset is automatically an event; in continuous spaces this can fail to admit a consistent probability (non-measurable sets) |
| Sequential/infinite experiments (e.g. flip a coin forever) | , the set of infinite sequences | Trying to list by enumeration; it is uncountable, so outcomes must be described structurally, not listed |
| Compound experiments | = Cartesian product of component sample spaces (Example 1) | Forgetting that order/labeling conventions (ordered vs. unordered draws) change and must match the physical description |
| "At least one of " | Confusing with , or with exclusive-or | |
| "Neither nor " | Writing instead — the classic De Morgan sign error | |
| Mutually exclusive vs. independent | Mutual exclusivity is a set relation (); independence is a probabilistic relation defined later | Treating disjointness and independence as synonyms — in fact disjoint events with positive probability are always dependent |
The mathematician behind it
The formal identification of "event" with "subset of a sample space," and the accompanying algebra of unions, intersections, and complements, crystallized through the joint development of set theory (Georg Cantor, late 19th century) and modern axiomatic probability. While the qualitative idea of combining chances via logical connectives dates to Pascal, Fermat, and Huygens in the 1650s–1660s, the precise set-theoretic scaffolding used throughout this article is due to the 20th-century measure-theoretic reformulation of probability.
Origins · 1 minAndrey Nikolaevich Kolmogorov and how this was discovered
Kolmogorov's 1933 monograph Grundbegriffe der Wahrscheinlichkeitsrechnung ("Foundations of the Theory of Probability") gave probability its modern axiomatic footing by explicitly building it atop measure theory: a sample space , a -algebra of events, and a probability measure satisfying countable additivity. Before Kolmogorov, "probability" lacked a universally agreed formal object; his framework — sample spaces and events as sets, exactly as presented here — became the unquestioned foundation for all subsequent probability theory, including The Axioms of Probability built directly on top of it.
What exactly distinguishes an "outcome" from an "event"?
An outcome is a single, indivisible element of the sample space — the most granular possible description of what happened, such as "the die showed a 4." An event is any subset , a collection of outcomes grouped by a shared property, such as "the die showed an even number," which is the subset . Every outcome determines a special one-element event , sometimes called an elementary event, but not every event is an outcome — most events (like "even") bundle several outcomes together. The distinction matters because probabilities are formally assigned to events (subsets), and the probability of an outcome is recovered as the probability of its singleton event.
Why must outcomes be mutually exclusive and exhaustive, but events need not be?
Outcomes model "what actually happens" on one performance of the experiment, and exactly one thing happens — hence outcomes must partition all possibilities without overlap (mutual exclusivity) while covering every possibility (exhaustiveness). Events, by contrast, are descriptive labels for properties of the outcome, and a single outcome can simultaneously satisfy several properties — e.g. rolling a 6 satisfies both "even" and "greater than 4." If events had to be disjoint, we could never express such natural overlapping descriptions, and compound statements built from "and"/"or" would be impossible to represent as sets, defeating the entire purpose of the framework, as the counterexample above demonstrates.
Can two different sample spaces describe the same experiment?
Yes, and this is common and legitimate. Rolling two dice can be modeled with the ordered sample space (36 outcomes, tracking which die is which) or, if the dice are physically indistinguishable and only the unordered result matters, with an unordered sample space of 21 outcomes. Both are valid provided the exhaustiveness and mutual-exclusivity requirements hold for the chosen description; the choice affects how outcomes are counted but, when probabilities are assigned consistently with the physical randomness, does not change the probability of any well-posed event. Choosing the sample space that matches what is physically observable and distinguishable is essential to avoid double-counting or under-counting later in Combinatorial Probability.
What happens when the sample space is infinite or continuous?
When is countably infinite (e.g. "number of coin flips until first head," ) the same subset-based definition of event applies without change: any subset is an event. When is uncountable (e.g. a dart landing anywhere in ), it turns out that not every subset can be consistently assigned a probability; one restricts attention to a well-behaved collection of subsets called a -algebra (typically the Borel sets). This refinement is developed fully in The Axioms of Probability; for finite and countable spaces, which dominate introductory examples, this subtlety never arises and every subset is automatically an event.
Is really an event, and can it ever "occur"?
Yes, is formally an event because it is a subset of (the empty subset). By definition, an event occurs when the realized outcome satisfies ; since no can belong to , the event never occurs, on any performance of the experiment. It represents "the impossible event" and plays the role of the additive identity once probabilities are introduced (its probability will always be ), while itself is the "certain event," always occurring since every outcome trivially belongs to .
How do "mutually exclusive" and "exhaustive" apply to events, as opposed to outcomes?
A collection of events is called mutually exclusive if for every , meaning no two of them can occur simultaneously — this generalizes the built-in mutual exclusivity of single outcomes to arbitrary events. The collection is called exhaustive if , meaning some event in the collection must occur. When a collection of events is both mutually exclusive and exhaustive, it is called a partition of ; the set of all singleton outcomes is the finest possible partition, but coarser partitions (like "even" vs. "odd" for a die) are equally legitimate and often more useful.
Why does this article avoid assigning any actual probabilities?
Because sample spaces and events are purely set-theoretic objects — they specify what can happen and how to describe combinations of possibilities, with no reference yet to how likely anything is. Probabilities are a separate ingredient, a function from events to numbers in satisfying specific axioms (non-negativity, normalization , and countable additivity over disjoint events). Building that function rigorously, and deriving its consequences, is the subject of The Axioms of Probability; keeping the two stages strictly separate is what makes each stage's logic transparent and prevents subtle circular reasoning about "equally likely outcomes" before the axioms justify it.