Conditional Probability
Conditional probability is the probability that an event occurs given that another event has already occurred. When we receive new information about the outcome of a random experiment, that information can change our assessment of the likelihood of other outcomes. For example, if you know it is cloudy outside, the probability of rain is higher than it would be without that information. Conditional probability formalizes this intuition with a precise mathematical framework. This concept is foundational to almost every branch of probability and statistics, from medical testing and weather forecasting to machine learning and financial risk modeling. It allows us to update our beliefs rationally when new evidence arrives — a process that underpins Bayesian reasoning, one of the most powerful tools in modern data science and artificial intelligence. Conditional probability also reveals surprising and counterintuitive results. Famous puzzles like the Monty Hall problem and paradoxes in medical screening all hinge on misunderstanding how conditioning on an event changes the probability space. Mastering this concept equips you to reason carefully whenever partial information is available.
- Define the Sample Space and Events
- Restrict to the New Sample Space
- Find the Overlap
- Apply the Formula
- Interpret the Result
Define the Sample Space and Events
Start with a sample space S containing all possible outcomes of an experiment. Choose two events A and B, which are subsets of S. Event B is the condition we know has occurred; event A is the event whose probability we want to find under that condition.
Restrict to the New Sample Space
Once we know B has occurred, the only outcomes still possible are those inside B. We effectively replace the full sample space S with the restricted space B. Any outcome not in B is impossible given the condition.
Find the Overlap
Within this restricted space B, we want outcomes where A also occurs. These are the outcomes in the intersection A ∩ B — outcomes belonging to both A and B simultaneously.
Apply the Formula
Conditional probability is the ratio of the probability of the intersection P(A ∩ B) to the probability of the condition P(B). This rescales the probability so that outcomes in B add up to 1, giving P(A | B) = P(A ∩ B) / P(B), provided P(B) > 0.
Interpret the Result
The result P(A | B) is a valid probability between 0 and 1. If A and B are independent — knowing B gives no information about A — then P(A | B) = P(A). If A ⊆ B, then P(A | B) = P(A)/P(B) ≥ P(A), meaning the condition makes A more likely. Always check whether the conditioning event B has non-zero probability before applying the formula.
The Key Equation
- P(A \mid B) — Conditional probability of A given B (dimensionless): The probability that event A occurs, given that event B is known to have occurred. Its value lies in [0, 1].
- P(A \cap B) — Joint probability (dimensionless): The probability that both events A and B occur simultaneously. This is the overlap between the two events in the sample space.
- P(B) — Probability of the conditioning event (dimensionless): The probability that event B occurs. Must be strictly greater than zero for the conditional probability to be defined.
Worked Example
Problem. A standard deck of 52 playing cards is shuffled. One card is drawn at random. Given that the card drawn is a face card (Jack, Queen, or King), what is the probability that it is also a Heart?
Answer. The probability that the card is a Heart, given that it is a face card, is 1/4.
Origins · 1 minThomas Bayes and how this was discovered
Thomas Bayes was an English statistician and Presbyterian minister whose posthumously published essay introduced what we now call Bayes' theorem — a direct extension of conditional probability that allows us to update the probability of a hypothesis as new evidence is gathered. His formula P(A | B) = P(B | A)P(A) / P(B) is one of the most important results in the history of mathematics and forms the backbone of Bayesian statistics. Bayes never published his famous theorem himself. His friend Richard Price found the manuscript among Bayes' papers after his death and presented it to the Royal Society in 1763, two years after Bayes died.
Related Concepts
- Independence of Events — Two events are independent exactly when P(A | B) = P(A), making independence a special case of conditional probability where conditioning provides no new information.
- Bayes' Theorem — Bayes' theorem reverses conditional probabilities, expressing P(A | B) in terms of P(B | A). It is built directly on the conditional probability formula.
- Multiplication Rule of Probability — The multiplication rule P(A ∩ B) = P(A | B) · P(B) is an algebraic rearrangement of the conditional probability formula and is used to find joint probabilities.
- Law of Total Probability — This law uses conditional probabilities to compute the overall probability of an event by summing across all conditions in a partition of the sample space.