Causal Inference

Causal inference is the science of drawing conclusions about cause-and-effect relationships from data. Its central result: correlation alone cannot establish causation, but with explicit causal assumptions (encoded in graphs or counterfactuals) and proper study design, causal effects can be identified and estimated. Applies wherever we ask "what if?" — medicine, economics, epidemiology, public policy, machine learning. Pioneered by Sewall Wright (1920s), formalized by Donald Rubin, Jerzy Neyman, and Judea Pearl (1970s–2000s).

Causal inference is the branch of statistics and mathematics concerned with quantifying the effect of an intervention or treatment $T$ on an outcome $Y$ — that is, what would happen to $Y$ if we set $T$ to a particular value, as opposed to merely observing it. It matters because nearly every actionable scientific and policy question is causal ("does this drug cure?", "does education raise wages?"), yet ordinary statistical association does not answer such questions. The framework rests on potential outcomes (counterfactuals) and causal graphs, which make assumptions explicit and testable. A surprising fact: a treatment can appear beneficial in every subgroup of a population yet harmful overall — Simpson's paradox — and only causal reasoning, not statistics, resolves which conclusion is correct.

The Core Insight

Every causal question is a question about counterfactuals: comparing the outcome a unit would have had under treatment with the outcome it would have had under control. Since we can never observe both for the same unit (the fundamental problem of causal inference), causal inference is fundamentally a missing-data problem solved only by combining data with assumptions about how the data were generated. The distinction between $P (Y ∣ T = t)$ (seeing) and $P (Y ∣ d o (T = t))$ (doing) is the entire subject in one symbol.

Formal Statement

Potential Outcomes (Neyman–Rubin Framework)

For each unit $i$ in a population and a binary treatment $T_{i} \in {0, 1}$ , define two potential outcomes:

$Y_{i} (1)$ — the outcome unit $i$ would exhibit if treated,
$Y_{i} (0)$ — the outcome unit $i$ would exhibit if untreated.

The individual treatment effect is

τ_{i} = Y_{i} (1) - Y_{i} (0) .

⟳This is a definition — the difference of the two counterfactual outcomes for the same unit. Only one term is ever observed.

The observed outcome is linked to potential outcomes by the consistency assumption:

Y_{i} = T_{i} Y_{i} (1) + (1 - T_{i}) Y_{i} (0) .

⟳Whichever treatment is actually received "switches on" the corresponding potential outcome; the other is counterfactual and unobserved.

Symbols: $i$ indexes units; $T_{i}$ is the realized treatment; $Y_{i}$ is the realized outcome; $Y_{i} (t)$ is the potential outcome under treatment level $t$ .

Average Treatment Effect (ATE)

The population-level causal estimand of primary interest is the Average Treatment Effect:

ATE = E [Y (1) - Y (0)] = E [Y (1)] - E [Y (0)] .

⟳Take the expectation of [1] over the population and use linearity of expectation.

Related estimands: the Average Treatment effect on the Treated (ATT) $= E [Y (1) - Y (0) ∣ T = 1]$ , and the Conditional ATE (CATE) $τ (x) = E [Y (1) - Y (0) ∣ X = x]$ .

The Fundamental Problem of Causal Inference

By [2], for any unit we observe either $Y_{i} (1)$ or $Y_{i} (0)$ , never both. Hence $τ_{i}$ in [1] is never directly observed for any individual. Causal inference must therefore reconstruct the missing potential outcome using assumptions — it is, structurally, a problem of inferring counterfactuals from factual data.

Identification Assumptions

The ATE is identified (computable from observational data) under three conditions:

Ignorability / Unconfoundedness: ${Y (0), Y (1)} ⊥ ⊥ T ∣ X$ — given covariates $X$ , treatment is as good as randomly assigned.
Positivity / Overlap: $0 < P (T = 1 ∣ X = x) < 1$ for all $x$ — every covariate stratum contains both treated and untreated units.
SUTVA (Stable Unit Treatment Value Assumption): no interference between units and a single version of each treatment.

Identification via Adjustment / Back-door Formula

Under unconfoundedness and positivity, the ATE is identified from observed data by:

ATE = E_{X} [E [Y ∣ T = 1, X] - E [Y ∣ T = 0, X]] .

⟳Replace

E [Y (t) ∣ X]

E [Y ∣ T = t, X]

using ignorability + consistency, then average over

X

Equivalently, in Pearl's notation, the interventional distribution equals the back-door adjustment formula:

P (Y ∣ d o (T = t)) = x \sum P (Y ∣ T = t, X = x) P (X = x) .

⟳Condition on a set

X

that blocks all back-door paths from

T

Y

in the causal DAG; intervention severs incoming edges to

T

, leaving this weighting by the marginal

P (X)

:::proof[Identification of $E [Y (1)]$ ]

By the law of total expectation, $E [Y (1)] = E_{X} [E [Y (1) ∣ X]]$ .
By ignorability, $Y (1) ⊥ ⊥ T ∣ X$ , so $E [Y (1) ∣ X] = E [Y (1) ∣ T = 1, X]$ .
By positivity, the conditioning event $T = 1, X = x$ has positive probability, so step 2 is well-defined.
By consistency [2], when $T = 1$ we have $Y = Y (1)$ , hence $E [Y (1) ∣ T = 1, X] = E [Y ∣ T = 1, X]$ — a quantity of observed variables.
Therefore $E [Y (1)] = E_{X} [E [Y ∣ T = 1, X]]$ . Symmetrically for $E [Y (0)]$ . Subtracting gives [4]. $■$

Judea Pearl | b. 1936

Israeli-American computer scientist and Turing Award laureate (2011). Pearl developed the do-calculus and the structural-causal-model framework, giving causal inference a graphical algebra. His "ladder of causation" — association, intervention, counterfactuals — organizes the entire field. His book Causality (2000) unified graphical and counterfactual approaches and made $d o (\cdot)$ standard notation. Pearl argued that data alone is "profoundly dumb" without a model of how it arose.

Building Intuition

Imagine two worlds running in parallel. In World A everyone takes the drug; in World B no one does. The ATE is the difference in average outcome between these two entire worlds. Reality only ever shows us one world, and worse, a mixture: the people who actually took the drug are not a random sample — sicker people may self-select into treatment. This confounding is the villain of the whole subject. Randomization defeats it by making treatment independent of who-you-are; observational adjustment defeats it by conditioning on the variables $X$ that drove the self-selection, effectively comparing like-with-like within strata.

Confounding: a back-door path from treatment to outcome through a confounder

<svg viewBox="0 0 460 260" xmlns="http://www.w3.org/2000/svg">
<rect width="460" height="260" fill="#0a0e17"/>
<!-- nodes -->
<circle cx="90" cy="200" r="26" fill="none" stroke="#94a3b8" stroke-width="2"/>
<text x="90" y="205" fill="#e2e8f0" font-size="16" text-anchor="middle">T</text>
<circle cx="370" cy="200" r="26" fill="none" stroke="#94a3b8" stroke-width="2"/>
<text x="370" y="205" fill="#e2e8f0" font-size="16" text-anchor="middle">Y</text>
<circle cx="230" cy="60" r="26" fill="none" stroke="#d4a853" stroke-width="2.5"/>
<text x="230" y="65" fill="#e2e8f0" font-size="16" text-anchor="middle">X</text>
<!-- causal arrow T->Y -->
<line x1="116" y1="200" x2="344" y2="200" stroke="#d4a853" stroke-width="2.5" marker-end="url(#a)"/>
<text x="230" y="225" fill="#d4a853" font-size="13" text-anchor="middle">causal effect</text>
<!-- confounding edges -->
<line x1="210" y1="82" x2="105" y2="178" stroke="#94a3b8" stroke-width="2" marker-end="url(#b)"/>
<line x1="250" y1="82" x2="355" y2="178" stroke="#94a3b8" stroke-width="2" marker-end="url(#b)"/>
<text x="120" y="120" fill="#94a3b8" font-size="13">back-door</text>
<text x="300" y="120" fill="#94a3b8" font-size="13">path</text>
<defs>
<marker id="a" markerWidth="10" markerHeight="10" refX="8" refY="3" orient="auto"><path d="M0,0 L8,3 L0,6 Z" fill="#d4a853"/></marker>
<marker id="b" markerWidth="10" markerHeight="10" refX="8" refY="3" orient="auto"><path d="M0,0 L8,3 L0,6 Z" fill="#94a3b8"/></marker>
</defs>
<text x="230" y="250" fill="#e2e8f0" font-size="12" text-anchor="middle">Adjusting for X blocks the back-door path, isolating the causal effect</text>
</svg>

Worked Examples

Estimating ATE by Stratified Adjustment

Given: A study of a drug (

T

) on recovery (

Y \in {0, 1}

), with a confounder severity

X \in {mild, severe}

| Stratum | $P (X)$ | $E [Y ∣ T = 1, X]$ | $E [Y ∣ T = 0, X]$ | |---|---|---|---| | mild | 0.6 | 0.90 | 0.80 | | severe | 0.4 | 0.50 | 0.30 |

Steps:

Stratum effect (mild): $0.90 - 0.80 = 0.10$ .
Stratum effect (severe): $0.50 - 0.30 = 0.20$ .
Apply back-door formula [4]: weight by $P (X)$ :

ATE = 0.6 (0.10) + 0.4 (0.20) = 0.06 + 0.08 = 0.14.

Boxed answer:

ATE = + 0.14 (a 14 percentage-point increase in recovery probability)

Note: a naive unadjusted comparison would mis-weight by the treated/untreated mix and could even reverse sign (Simpson's paradox).

Inverse-Probability Weighting (IPW)

Given:

n = 4

units. Propensity

e (x) = P (T = 1 ∣ X)

, observed treatment

T

, outcome

Y

| Unit | $e (x)$ | $T$ | $Y$ | |---|---|---|---| | 1 | 0.25 | 1 | 8 | | 2 | 0.25 | 0 | 4 | | 3 | 0.80 | 1 | 6 | | 4 | 0.80 | 0 | 2 |

The IPW estimator for $E [Y (t)]$ :

\hat{E} [Y (1)] = \frac{1}{n} i \sum \frac{T _{i} Y _{i}}{e ( X _{i} )}, \hat{E} [Y (0)] = \frac{1}{n} i \sum \frac{( 1 - T _{i} ) Y _{i}}{1 - e ( X _{i} )} .

⟳Dividing by the probability of the observed treatment re-creates a pseudo-population in which treatment is independent of

X

; expectation of the weighted indicator reproduces the marginal potential-outcome mean.

Steps:

$\hat{E} [Y (1)] = \frac{1}{4} (\frac{8}{0.25} + \frac{6}{0.80}) = \frac{1}{4} (32 + 7.5) = 9.875.$
$\hat{E} [Y (0)] = \frac{1}{4} (\frac{4}{0.75} + \frac{2}{0.20}) = \frac{1}{4} (5.333 + 10) = 3.833.$
$ATE = 9.875 - 3.833 = 6.042.$

Boxed answer:

ATE \approx 6.04 (outcome units)

Common Misconceptions

Correlation is not Causation — but neither is "controlling for everything"

Adding more covariates to a regression does not monotonically improve causal estimates. Conditioning on a collider (a common effect of $T$ and $Y$ ) or on a mediator (a variable on the causal path) introduces bias rather than removing it. The correct adjustment set is determined by the causal graph, not by which variables raise $R^{2}$ or by statistical significance.

Collider / Selection Bias

Suppose talent $T$ and beauty $Y$ are independent in the general population, but both increase the chance of becoming a Hollywood star $C$ (a collider). Among stars (conditioning on $C = 1$ ), talent and beauty become negatively correlated — a less talented star must be especially beautiful to have made it. Thus conditioning on a collider manufactures a spurious association between two genuinely independent causes. Blindly "controlling for" $C$ would corrupt an otherwise clean causal estimate.

Simpson's Paradox

A drug improves recovery in both mild and severe patients separately (positive stratum effects), yet appears harmful in the pooled data because severe patients — who recover less often regardless — were disproportionately given the drug. The aggregate association reverses the true causal direction. Only the back-door adjustment [4] (not the raw table) yields the correct conclusion, and which answer is correct depends on whether $X$ is a confounder or a mediator — a causal, not statistical, distinction.

Connections

Causal inference sits at the intersection of several fields. It generalizes Regression Analysis, reinterpreting coefficients as causal effects only under explicit assumptions. It relies on Probability Theory and Conditional Expectation for its estimands, and on Directed Acyclic Graphs for encoding qualitative causal knowledge. The d-separation criterion from graph theory determines conditional independencies and valid adjustment sets. Modern estimation borrows from Machine Learning (e.g., causal forests, double/debiased ML) to flexibly model $E [Y ∣ T, X]$ and the propensity score. It is deeply linked to Experimental Design, whose randomization guarantees ignorability by construction.

Real-World Applications

Randomized clinical trials (RCTs): the FDA gold standard; randomization enforces unconfoundedness so [4] reduces to a simple difference of means.
Epidemiology — smoking and lung cancer: Cornfield's 1959 sensitivity argument and later causal modeling established causation absent any RCT.
Economics — the minimum wage: Card & Krueger's natural experiment (New Jersey vs. Pennsylvania) used difference-in-differences, a causal design.
Tech A/B testing: Google, Netflix, and Amazon run millions of randomized experiments to causally estimate the effect of interface changes.
Public policy — job training programs: the LaLonde dataset became the benchmark for testing whether observational methods (matching, IPW) can replicate experimental ATEs.
Mendelian randomization: genetic variants serve as instrumental variables to estimate causal effects of biomarkers, exploiting random allele assignment at conception.
Recommender & ad systems: uplift modeling (CATE estimation) targets interventions at users who will actually be moved by them.

Historical Development

1921 — Sewall Wright invents path analysis, the first formal method to decompose correlations into causal paths.
1923 — Jerzy Neyman, in his master's thesis, introduces potential outcomes for randomized agricultural experiments.
1925 — R. A. Fisher formalizes randomization as the basis of experimental inference in The Design of Experiments.
1959 — Cornfield et al. publish a sensitivity-analysis argument for smoking causing lung cancer; Bradford Hill (1965) proposes his viewpoints for causation.
1974 — Donald Rubin extends potential outcomes to observational studies, founding the Rubin Causal Model.
1983 — Rosenbaum & Rubin introduce the propensity score, proving adjustment on it suffices for unconfoundedness.
1986 — Robins develops the g-formula and methods for time-varying treatments.
1995–2000 — Judea Pearl formalizes do-calculus, structural causal models, and the back-door/front-door criteria; Causality (2000).
2018 — Pearl & Mackenzie's The Book of Why popularizes the "ladder of causation"; the era of causal machine learning begins.

Subtleties & Limits

Unmeasured confounding is the field's central unsolved difficulty: ignorability is untestable from data alone, so all observational estimates rest on a faith assumption. Sensitivity analysis quantifies how strong a hidden confounder would need to be to overturn a conclusion, but cannot prove its absence. Other open frontiers: (i) transportability — when do causal effects estimated in one population transfer to another? (ii) interference / spillovers that violate SUTVA in networks and markets; (iii) reliable CATE estimation with high-dimensional covariates and honest uncertainty; (iv) causal discovery — learning the DAG itself from data, which is provably non-identifiable without further assumptions; and (v) reconciling counterfactual and interventional queries when the structural mechanism is unknown.