Modeling with Distributions

Probability modeling is the process of choosing a mathematical distribution that accurately describes the random behavior of real-world data. Just as a map is a simplified representation of geography, a probability distribution is a simplified model of how likely different outcomes are. When scientists measure radioactive decay, engineers test product failure rates, or epidemiologists track disease spread, they each rely on carefully selected probability distributions to make predictions and decisions. The key skill in modeling with distributions is recognizing which distribution fits the structure of your random process. Is the outcome a count of events in a fixed interval? Is it the waiting time until something happens? Is it a continuous measurement that clusters around a mean? Each of these situations corresponds to a specific family of distributions — such as the Binomial, Poisson, Exponential, or Normal — each with its own parameters, formulas, and assumptions. Selecting the wrong distribution leads to poor predictions and flawed conclusions. A good modeler first examines the data's characteristics: whether values are discrete or continuous, bounded or unbounded, symmetric or skewed. They then check whether the mathematical assumptions of the candidate distribution are satisfied before applying it. This article walks through the major distributions used in high school mathematics, the criteria for choosing them, and worked examples showing how real data is matched to the right model.

Key takeaways
  • Identify Whether the Data Is Discrete or Continuous
  • Check the Structure of the Random Process
  • Identify the Parameters from Context
  • Verify the Assumptions
  • Apply the Probability Formula and Interpret

Identify Whether the Data Is Discrete or Continuous

Discrete data takes only countable values (0, 1, 2, 3, …), such as the number of goals scored or defective items in a batch. Continuous data can take any value in an interval, such as height, temperature, or time. Discrete data calls for discrete distributions (Binomial, Geometric, Poisson), while continuous data calls for continuous distributions (Normal, Exponential, Uniform).

Check the Structure of the Random Process

Ask: Is there a fixed number of independent trials, each with the same probability of success? → Use Binomial(n, p). Are you counting events that occur at a constant average rate in a fixed interval, with events independent of each other? → Use Poisson(λ). Are you measuring the waiting time between Poisson events? → Use Exponential(λ). Is the variable the result of many small independent additive effects? → Use Normal(μ, σ²). Are all outcomes in an interval equally likely? → Use Uniform(a, b).

Identify the Parameters from Context

Each distribution is controlled by parameters. For the Binomial, n is the number of trials and p is the success probability per trial. For the Poisson, λ (lambda) is the average number of events per interval. For the Normal, μ is the mean and σ is the standard deviation. Always extract these values from the problem context before writing any formula or making any calculation.

Verify the Assumptions

Before committing to a distribution, check its assumptions. Binomial requires: fixed n, only two outcomes per trial, constant p, and independence between trials. Poisson requires: events occur singly, at a constant average rate, and independently. Normal requires: the variable is continuous and the distribution is approximately symmetric and bell-shaped. If assumptions are violated — for example, p changes across trials — the model may be unreliable and a different distribution should be used.

Apply the Probability Formula and Interpret

Once the distribution is chosen and parameters identified, apply the correct probability mass function (PMF) for discrete distributions or probability density function (PDF) for continuous ones. Always interpret the result in context: a probability of 0.03 means a 3% chance, not a guarantee. For continuous distributions, probabilities are found over intervals using integration or z-score tables, never at a single point (since P(X = x) = 0 for a continuous variable).

The Key Equation

P(X=k)=(nk)pk(1−p)n−k,k=0,1,2,…,nP(X = k) = \binom{n}{k} p^k (1-p)^{n-k}, \quad k = 0, 1, 2, \ldots, n
  • P(X = k) — Probability of k successes (dimensionless): The probability that the random variable X equals exactly k, a value between 0 and 1.
  • \binom{n}{k} — Binomial coefficient (dimensionless): The number of ways to choose k successes from n trials, equal to n! / (k!(n−k)!).
  • p — Success probability (dimensionless): The probability of success on any single trial; must satisfy 0 ≤ p ≤ 1.
  • n — Number of trials (dimensionless): The fixed number of independent trials conducted in the experiment.
  • k — Number of successes (dimensionless): The specific count of successes whose probability is being calculated; k is an integer from 0 to n.

Worked Example

Problem. A factory produces light bulbs, and historically 8% of bulbs are defective. A quality inspector randomly selects 15 bulbs. (a) Which distribution should be used, and why? (b) What is the probability that exactly 2 of the 15 bulbs are defective? (c) What is the expected number of defective bulbs?

P(X=2)=(152)(0.08)2(0.92)13≈0.2273;E(X)=np=15×0.08=1.2P(X=2) = \binom{15}{2}(0.08)^2(0.92)^{13} \approx 0.2273; \quad E(X) = np = 15 \times 0.08 = 1.2

Answer. The Binomial distribution applies. The probability of exactly 2 defective bulbs is approximately 22.7%. The expected number of defective bulbs is 1.2.

Figure
Diagram
Choosing a Probability DistributionRandom Variable XIs X discrete or continuous?DiscreteContinuousFixed n trials, const p?Bell-shaped, symmetric?YesNoYesNoBinomialB(n, p)PoissonPois(λ)NormalN(μ, σ²)ExponentialExp(λ)Also check: Geometric (discrete, waiting) · Uniform (continuous, equal likelihood)
Origins · 1 minSiméon Denis Poisson and how this was discovered
SD
Siméon Denis Poisson
1781–1840 · French

Poisson introduced the probability distribution that bears his name in his 1837 work 'Recherches sur la probabilité des jugements' (Research on the Probability of Judgments). He derived it as a limiting case of the Binomial distribution when n is very large and p is very small, yielding a distribution ideal for modeling rare events such as equipment failures, accident rates, and particle emissions. His formula P(X=k) = e^{-λ}λ^k / k! remains one of the most widely applied results in probability theory. Poisson once remarked that 'life is good for only two things: doing mathematics and teaching it.' He published over 300 papers in his lifetime on topics ranging from mechanics to electrostatics, but it was his slim 1837 book on probability that ultimately made him immortal in the eyes of statisticians.

  • Binomial Distribution — The Binomial distribution is the most commonly selected model for discrete data with a fixed number of independent trials, making it essential to understand before applying distribution modeling techniques.
  • Poisson Distribution — The Poisson distribution models rare-event counts in a fixed interval and is a key alternative to the Binomial when n is large and p is small, appearing frequently in real-world modeling contexts.
  • Normal Distribution — The Normal distribution is the most important continuous distribution in statistics and arises naturally through the Central Limit Theorem, making it fundamental to modeling continuous real-world data.
  • Expected Value — Once a distribution is selected, expected value quantifies the long-run average outcome and is one of the first quantities calculated from any probability model.
  • Hypothesis Testing — Hypothesis testing uses probability distributions to assess whether observed data is consistent with a proposed model, connecting distribution selection directly to statistical inference.