The Poisson Distribution
Consider a call center that receives, on average, 5 calls per minute during peak hours. How many calls arrive in the next minute? This is not a fixed number: it fluctuates. Yet it obeys a strikingly regular pattern. The Binomial Distribution almost applies. Imagine chopping the minute into a huge number of tiny slivers. Each sliver either contains a call or not. But the number of slivers is arbitrary. The "success probability" per sliver shrinks as we refine the chopping. The Poisson distribution is what emerges in the limit. It turns out to depend on only one number: the rate. This matters because an enormous range of real phenomena share this structure. They involve rare events, occurring independently, over a continuum of time or space. Each has a fixed average rate. Radioactive decays per second, typos per page, customers per hour, mutations per genome, goals per soccer match: all are modeled this way. Each counts occurrences of something individually improbable but collectively frequent. The Poisson distribution is the mathematical shadow cast by the Binomial Distribution. This happens when the number of trials grows without bound. Meanwhile the total expected number of successes is held fixed. The big picture is a limiting procedure. It trades two parameters (, the number of trials, and , the probability per trial) for a single parameter , the rate. This is a genuine simplification. Instead of needing to know how finely to subdivide time, we only need the average count. The limit theorem that makes this rigorous is often called the law of rare events, or the Poisson limit theorem. It is one of the cleanest asymptotic results in elementary probability. It explains why the Poisson formula appears with such uncanny frequency in applications. This article gives the precise definition of the Poisson probability mass function. It proves the binomial-to-Poisson limit theorem with full rigor, including an explicit error bound. It works through two asymmetric numerical examples. It shows via a counterexample exactly which hypothesis cannot be dropped. It closes by tracing the distribution's history and its role in modern applications. Finally, it shows its natural continuation into the Exponential Distribution and Moment Generating Functions.
- The Poisson distribution models counts of rare, independent events occurring at a known average rate .
- Its PMF is for , a single-parameter family.
- It arises as the limit of the Binomial Distribution as , , with fixed.
- Both the mean and variance of a Poisson random variable equal — a hallmark diagnostic of Poisson-ness.
- The limit theorem comes with an explicit, provable error bound, not just a heuristic convergence claim.
- Key idea: many independent rare events, summed up, behave like a single random variable governed by one number — the rate.
Where this lives today
The Poisson distribution is the default model for count data across science and engineering. In telecommunications and queueing theory it models the number of arriving calls, packets, or customers per unit time, directly feeding into the design of call centers and network buffers. In physics, radioactive decay counts detected by a Geiger counter in a fixed interval are Poisson, and the distribution underlies statistical uncertainty quotes in particle physics ("Poisson counting error," ). In genetics and genomics, the number of mutations or read-counts along a sequence is often modeled as Poisson (or its overdispersed cousin, the negative binomial). In actuarial science and insurance, the number of claims filed in a year is a Poisson-distributed count feeding into risk models. In natural language processing and text analysis, rare word or error occurrences per document are approximated by Poisson counts. Cryptographic and reliability engineering use Poisson models for the number of rare failure events (e.g., bit-flip errors) over a fixed exposure. The distribution's memoryless "rate" structure connects it intimately to the continuous-time Exponential Distribution, which governs the waiting time between Poisson events, and its generating-function machinery is a natural first example when studying Moment Generating Functions and characteristic functions, where the Poisson MGF gives an especially clean closed form.
:::quiz[If , what are and ?]
- Both equal
- ,
- Both equal ✓
- ,
Ask the tutor: How does the Poisson distribution connect to the exponential distribution through the idea of a Poisson process?
A discrete random variable taking values in is said to have the Poisson distribution with rate parameter , written , if its probability mass function is
This is a valid probability mass function because each term is nonnegative and, by the Taylor series of the exponential function,
Intuition
Picture the call center again. Over one minute, calls arrive at scattered, essentially unpredictable instants. Slice the minute into equal sub-intervals. If is large enough that at most one call falls in each sub-interval, then the number of calls is approximately , where is the (small) chance of a call in one sub-interval. As we refine the slicing — sending — the per-slice probability must shrink, but the total expected number of calls should stay pegged at the true average rate . The Poisson distribution is the distribution that survives this limit: it is what "many independent coin flips, each almost always tails, but with a fixed total expected number of heads" looks like when you stop caring about how the flips were divided up. The shape of the Poisson PMF reflects this: it is unimodal, concentrated near , with a right skew that diminishes as grows (by the Central Limit Theorem, appropriately standardized Poisson counts approach normality for large ). Unlike the binomial, there is no fixed upper bound on — arbitrarily many events remain possible, just increasingly unlikely.
Let be a sequence of probabilities such that
for some fixed constant . For each , let . Then for every fixed integer ,
That is, the binomial PMF converges pointwise to the Poisson PMF with rate .
Technique: direct algebraic manipulation of the binomial PMF, term-by-term limit evaluation, justified by elementary limit laws (product and composition of convergent sequences), with no appeal to any result depending on the Poisson distribution itself. Fix and write , so that by hypothesis, and . By the definition of the binomial PMF,
We split this into three factors and take the limit of each, since is fixed and finitely many factors converging implies the product converges (limit of a product of convergent sequences).
Factor 1: the combinatorial term. Write
Since is fixed, each of the factors as , so the finite product converges to . Hence
Factor 2: the numerator power. We have because and is continuous (a fixed finite power of a convergent sequence converges to the power of the limit).
Factor 3: the term. We claim
To see this, write . Since , for all sufficiently large we have , so (continuity of at , valid once is bounded away from , which holds for large ). For the main factor, take logarithms (valid for large since eventually):
Use the elementary inequality, valid for ,
which follows from the Taylor series : the upper bound drops all terms beyond the first (all negative), and the lower bound follows by bounding . Apply this with :
As , and , so the left side tends to and the right side tends to . By the squeeze theorem,
and by continuity of the exponential function,
Combining with gives Factor 3: .
Combining the factors. Multiplying the three convergent factors,
which is exactly the Poisson PMF at . Since was an arbitrary fixed nonnegative integer, this holds for every , completing the proof.
∎Let and . Then, writing ,
(This is a special case of the Chen–Stein bound for Poisson approximation; it shows the theorem above is not merely a limit statement but comes with a quantitative rate of convergence — of order for fixed .)
Worked examples
Example 1 — a call center with an asymmetric, non-round rate. A support line receives calls at an average rate of calls per minute. Assume the count of calls in a given minute is Poisson (justified by the limit theorem, treating the minute as split into many independent, low-probability micro-intervals). Find the probability that exactly 6 calls arrive in a given minute, and the probability of at least 2 calls. Using the PMF with , :
Compute : , , , , . Also and . So
For "at least 2," use the complement:
. . So
So there is roughly an 11.4% chance of exactly 6 calls in the minute, and a 92.2% chance of at least 2 calls — reflecting that with rate 4.2, having fewer than 2 calls is the unusual event.
Example 2 — using the binomial approximation to justify (and check) the Poisson model. A factory produces microchips per day; each chip is independently defective with probability (an intentionally non-round pair of numbers). The number of defective chips per day is exactly . Approximate using the Poisson approximation, and bound the error using the lemma above. First, (chosen to match Example 1, so we can compare the exact binomial value to the limiting Poisson value). The Poisson approximation gives, from Example 1's method with :
Now compute the true binomial value directly:
We have . Compute numerator: ; times ; divide by 6: . Next, . Multiplying: . Finally, : take logs, (using for small , here ), so , giving . Combining: . Comparing to the Poisson approximation , the two differ by about — very small, consistent with the lemma's bound on the total variation distance summed over all (an aggregate bound, so the single-term discrepancy is comfortably inside it). This numerically confirms the Poisson limit theorem is not just qualitative but practically accurate even at moderate .
The hypothesis (a finite constant) is essential; if instead , the binomial distribution does not converge to any Poisson law, and the limiting PMF claimed by the theorem fails outright. Take , so rather than to a finite . Fix and examine . Taking logs,
so . But under any fixed Poisson law, for every finite . Since while no Poisson PMF has mass at , the binomial sequence cannot be converging to any Poisson distribution. Concretely, at : , , and — vanishingly small, utterly unlike a Poisson mass at . This shows the finiteness of the limiting rate is not a technical nicety but a load-bearing hypothesis: without it, the entire limiting shape changes (in this regime the correctly centered and scaled binomial instead approaches a Normal distribution, by the Central Limit Theorem, not a Poisson one).
Scope, edge cases & common traps
| Situation | Correct handling |
|---|---|
| large, small, moderate | Poisson is an excellent approximation to Binomial |
| large, small, | Poisson approximation fails; use Normal approximation instead |
| large, not small (e.g. ) | Use Normal approximation to the binomial, not Poisson |
| Sum of independent Poissons | (provable via convolution) |
| Conditioning a Poisson count on time interval | Splitting a Poisson process over disjoint intervals yields independent Poissons — foreshadows the Exponential Distribution as the interarrival law |
| Estimating from data | The sample mean is the maximum likelihood estimator, since |
The mathematician behind it
Origins · 1 minSiméon Denis Poisson and how this was discovered
Siméon Denis Poisson was a French mathematician and physicist whose name is attached to results across mathematical physics — Poisson's equation in electrostatics and gravitation, the Poisson bracket in classical mechanics, and Poisson summation — as well as to this probability distribution. His 1837 treatise Recherches sur la probabilité des jugements en matière criminelle et en matière civile introduced the distribution now bearing his name as a limiting case of the binomial law, in the context of modeling the probability of judicial errors in criminal versus civil trials — an early application to legal and social statistics rather than to physics.
Why does the Poisson distribution have only one parameter, while the binomial has two?
The binomial needs both the number of trials and the per-trial probability because it describes a finite, fixed-size population of trials. The Poisson distribution arises precisely when we let and together, so that the individual values of and become irrelevant — only their product survives in the limit. This is analogous to how a physical rate (e.g., "5 events per minute") does not care how finely you subdivide the minute; the subdivided-count description (, ) collapses into a single rate description () once the subdivision is infinitely fine.
Is the Poisson distribution the same as a Poisson process?
No, though they are closely related. The Poisson distribution is a single random variable's distribution — the count of events in one fixed interval. A Poisson process is a full stochastic process on a continuum (usually time), specifying that counts over any interval are Poisson-distributed with rate proportional to the interval's length, and counts over disjoint intervals are independent. The Poisson distribution is the "one-time snapshot" of a Poisson process; the interarrival times of a Poisson process follow the Exponential Distribution, giving the continuous-time partner to this discrete count distribution.
How do I know when to use Poisson versus Binomial versus Normal for a counting problem?
Use the exact Binomial whenever and are both genuinely known and finite and exact computation is feasible. Use the Poisson approximation when is large, is small, and the product is a moderate, stable number (a common rule of thumb: , ). Use the Normal approximation to the binomial (via the Central Limit Theorem) when is large but is not small — specifically when and are both comfortably large (e.g., both or ), since in that regime the binomial is well approximated by a bell curve rather than a skewed count distribution.
Why is the variance of a Poisson random variable equal to its mean?
This equality, , follows directly from computing moments with the PMF: one shows and by direct series manipulation, giving and hence . It is also inherited from the binomial limit: has mean and variance , and as with fixed, the variance , matching the mean in the limit. This equal-mean-variance property is a useful diagnostic: real count data with variance far from its mean (over- or under-dispersion) is a signal that a pure Poisson model may not fit.
Can the Poisson distribution take negative or non-integer values?
No. By definition the support of the Poisson PMF is — it is a discrete distribution on the nonnegative integers, since it counts a whole number of discrete events (calls, decays, defects) and a count can never be negative or fractional. This distinguishes it sharply from continuous distributions like the Exponential Distribution, which models a continuous waiting time between such discrete Poisson events, but is itself defined on rather than on the integers.
What does the rate parameter actually represent, physically?
The parameter is simultaneously the expected number of events in the interval or region under study and the variance of that count, since for . It is derived as in the limiting binomial construction — the total expected count of successes as the number of trials grows and the per-trial probability shrinks correspondingly. Practically, is estimated from data as the observed average count per unit interval (e.g., average calls per minute, average decays per second), and it fully determines the entire probability mass function via the formula .
Does the theorem give any control over how fast the binomial approaches the Poisson, or is it purely a limiting statement?
It is more than a bare limit. As stated in the accompanying Chen–Stein-type lemma, the total variation distance between and is bounded above by for fixed. This shows the approximation error shrinks like as grows with held fixed, giving a concrete, checkable guarantee rather than just qualitative reassurance — exactly the kind of bound used to justify the approximation numerically in applied settings such as Example 2 above.