Basic Probability Concepts
Probability is the mathematical language we use to describe how likely an event is to occur. Every time you flip a coin, roll a die, or predict whether it will rain tomorrow, you are reasoning about probability — even if informally. In mathematics, probability gives us a precise, consistent framework for quantifying uncertainty and making predictions about random processes. The probability of an event is always a number between 0 and 1, inclusive. A probability of 0 means the event is impossible — it will never happen. A probability of 1 means the event is certain — it will always happen. Every other event falls somewhere in between, and the closer the probability is to 1, the more likely that event is to occur. For example, rolling a number less than 7 on a standard six-sided die has probability 1, while rolling a 7 has probability 0. Probability theory forms the foundation of statistics, data science, finance, medicine, and countless other fields. Whether scientists are testing a new drug, engineers are designing reliable systems, or analysts are modeling stock markets, they all rely on the core concepts you will study here. Understanding basic probability is not just an academic exercise — it is an essential tool for reasoning clearly about an uncertain world.
- Sample Space and Events
- The Classical Definition of Probability
- Complement, Union, and Intersection
- Mutually Exclusive Events
- Probability as Relative Frequency
Sample Space and Events
The sample space, denoted S (or Ω in formal texts), is the set of all possible outcomes of a random experiment. For example, when rolling a single six-sided die, S = {1, 2, 3, 4, 5, 6}. An event is any subset of the sample space. The event 'rolling an even number' is E = {2, 4, 6}, which contains 3 of the 6 outcomes.
The Classical Definition of Probability
When all outcomes are equally likely, the probability of an event E is calculated by dividing the number of outcomes in E by the total number of outcomes in the sample space S. This is written as P(E) = |E| / |S|, where |E| means 'the number of elements in E'. For rolling an even number: P(E) = 3/6 = 1/2 = 0.5. This classical definition works perfectly for fair coins, dice, and card draws.
Complement, Union, and Intersection
Three essential operations connect events. The complement of event A, written A' or Aᶜ, contains all outcomes NOT in A, and P(A') = 1 − P(A). The union A ∪ B includes outcomes in A or B or both. The intersection A ∩ B includes outcomes in both A and B. These operations obey the Addition Rule: P(A ∪ B) = P(A) + P(B) − P(A ∩ B). The subtraction avoids double-counting outcomes that belong to both events.
Mutually Exclusive Events
Two events are mutually exclusive (also called disjoint) if they cannot both happen at the same time — their intersection is empty: A ∩ B = ∅. For mutually exclusive events, P(A ∩ B) = 0, so the Addition Rule simplifies to P(A ∪ B) = P(A) + P(B). For example, rolling a 2 and rolling a 5 on one die roll are mutually exclusive events.
Probability as Relative Frequency
When outcomes are not equally likely, we can estimate probability empirically: run the experiment many times and record how often event E occurs. If E occurs f times in n trials, the relative frequency is f/n. As n grows very large, this ratio approaches the true probability — a principle called the Law of Large Numbers. For instance, if a thumbtack lands point-up 340 times in 500 tosses, we estimate P(point-up) ≈ 340/500 = 0.68.
The Key Equation
- P(E) — Probability of event E (dimensionless (0 to 1)): A number between 0 and 1 representing the likelihood that event E occurs.
- |E| — Cardinality of E (count): The number of outcomes in event E that are considered favorable or successful.
- |S| — Cardinality of sample space S (count): The total number of distinct, equally likely outcomes in the entire sample space.
Worked Example
Problem. A standard deck of 52 playing cards is shuffled and one card is drawn at random. (a) What is the probability of drawing a heart? (b) What is the probability of drawing a heart OR a king? (c) What is the probability of NOT drawing a heart?
Answer. P(heart) = 1/4; P(heart or king) = 4/13; P(not heart) = 3/4
Origins · 1 minGerolamo Cardano and how this was discovered
Cardano was one of the first mathematicians to develop a systematic treatment of probability. In his book Liber de Ludo Aleae (Book on Games of Chance), written around 1564 but published posthumously, he analyzed dice games using counting arguments and introduced the concept that probability could be calculated by comparing favorable outcomes to total outcomes — the classical formula we use today. Cardano was a passionate gambler whose desire to win at dice and card games reportedly motivated his entire mathematical investigation of probability. He also discovered general solutions to cubic and quartic equations, making him one of the most versatile mathematicians of the Renaissance.
Related Concepts
- Conditional Probability — Conditional probability extends basic probability by asking how likely an event is given that another event has already occurred, using the formula P(A|B) = P(A ∩ B) / P(B).
- Independent Events — Independence is a key property where knowing one event occurred gives no information about another; P(A ∩ B) = P(A)·P(B), directly building on the intersection concept introduced here.
- Combinatorics and Counting Principles — Calculating |E| and |S| in complex problems requires counting techniques such as permutations and combinations, which are essential for applying the classical probability formula.
- Probability Distributions — Once basic probability is established, probability distributions describe how probabilities are spread across all outcomes of a random variable, generalizing the ideas covered here.