Cosmological Parameter Estimation
Cosmological parameter estimation is the machinery that turns raw astronomical measurements — CMB maps, galaxy catalogues, supernova light curves, weak-lensing shear fields — into quantitative statements about the constituents and history of the Universe. Given a parametrized model, chiefly the ΛCDM Concordance Model, one predicts observables as a function of a parameter vector , builds a likelihood comparing prediction to data, and characterizes the resulting probability distribution over . The output is the familiar table of numbers — baryon and cold-dark-matter densities, the expansion rate, the amplitude and tilt of primordial fluctuations — each with an uncertainty and a full web of correlations. The dominant paradigm is Bayesian: parameters are random variables whose posterior encodes our knowledge after seeing the data, fusing the likelihood (how well a set fits) with a prior (what we assumed before). Because the posterior is high-dimensional and rarely Gaussian, one samples it numerically — Markov Chain Monte Carlo produces a cloud of points whose density traces it — while the Fisher information matrix gives a fast Gaussian approximation for forecasting surveys and exposing degeneracies. The predictive engine underneath is a Boltzmann code (CAMB, CLASS) integrating the Einstein–Boltzmann equations for the CMB spectra, the matter power spectrum, and background quantities like the sound horizon. A single dataset typically constrains only combinations of parameters — the CMB alone leaves a geometric degeneracy that BAO and supernovae break, while clustering and lensing carve the – plane. Combining independent probes is the whole art, and modern estimation has reached the sub-percent regime — sharp enough to turn two persistent discrepancies, the Hubble and tensions, into the central open questions of the field.
- Cosmological parameter estimation infers the parameters of a model (usually flat ΛCDM) by comparing theory to data through a likelihood, almost always in a Bayesian framework where .
- The base six-parameter set predicts the CMB spectra, the matter power spectrum, and the expansion history from which every observable follows.
- For Gaussian data , a ; the CMB likelihood is nearly Gaussian in at high but demands an exact non-Gaussian form at low .
- Posteriors are mapped by Markov Chain Monte Carlo; the Fisher matrix gives fast forecasts and the Cramér–Rao floor .
- Combining CMB, BAO, Type Ia supernovae and lensing breaks degeneracies — the geometric – locus and the – banana — and tightens everything.
- Planck 2018 gives , , ; the ~ Hubble and ~ tensions flag possible new physics or systematics.
- Key idea: a parametrized cosmological model plus a statistical likelihood turns diverse datasets into a joint posterior over parameters; combining independent probes breaks degeneracies, and the Fisher matrix quantifies how much information each dataset carries.
Where this lives today
Parameter estimation is the daily engine room of observational cosmology. Every Planck, ACT, and SPT analysis runs a Boltzmann code inside a Metropolis–Hastings or nested sampler; the public likelihoods (plik, CamSpec) and samplers (CosmoMC, Cobaya) are shared infrastructure. Galaxy surveys — BOSS, eBOSS, now DESI — feed BAO distances and full-shape spectra into the same framework, Pantheon+ supplies the low-redshift distance ladder, and DES, KiDS and HSC contribute weak-lensing . The frontier is the two tensions: the ~ Hubble discrepancy and the ~ offset have spawned a zoo of extended models — early dark energy, evolving –, extra relativistic species , interacting dark sectors — each tested by Bayes factors against base ΛCDM. Looking forward, Fisher forecasts are designing the next decade: CMB-S4, the Simons Observatory, Euclid, Rubin's LSST, and DESI are optimized around figures of merit like the dark-energy , tuning area, depth and redshift range to shrink the parameter ellipse before data arrive. The open question these tools were built to adjudicate is stark: are the tensions systematics, or the first cracks in the standard model of cosmology?
The physical picture
Think of the model as a machine with six dials. Turn them and it prints a predicted CMB spectrum and a predicted galaxy power spectrum. Estimation is the inverse problem: find the dial settings for which the printouts match the real sky, and quantify how sharply that match pins each dial. The likelihood is a scorecard measuring the mismatch; the posterior is the smeared-out region of dial space the data leave standing — a lumpy high-dimensional blob, and almost everything technical in the field is about mapping its shape honestly. A single experiment is never enough because most datasets measure combinations, not individual parameters. Different probes are like flashlights shining from different angles onto the same object. The CMB illuminates a long thin sliver in the – plane — the geometric degeneracy — because the acoustic peaks fix only the angular scale , and many pairs keep that ratio constant. BAO shines from another angle and lights a crossing band. Where the beams overlap is the constrained region, far smaller than either beam alone — which is why the headline numbers come from CMB + BAO + SNe and never one probe.
The Fisher matrix is the curvature of the log-likelihood at its peak, and it makes the flashlight picture quantitative: a sharply curved direction is well measured, a flat valley is a degeneracy, and the eigenvectors of are the natural combinations the data determine — the CMB measures to , but resolving it into and needs outside help. Marginalization — integrating the posterior over the parameters you are not reporting — is what produces honest error bars: it inflates a parameter's uncertainty to cover our ignorance of everything it correlates with, which is why marginalized errors are always at least as large as the errors from freezing every other parameter.
The core equations
Everything begins with Bayes' theorem, which is not an approximation but the definition of the posterior. It states how the prior belief is updated by data through the likelihood, with the evidence as the normalizing constant that also drives model comparison.
where: — posterior probability of parameters given data ; — likelihood, the probability of the data at fixed parameters; — prior over parameters; — Bayesian evidence (marginal likelihood). For parameter estimation is just a constant and can be ignored; for choosing between models it is the whole story. When the data residuals are Gaussian with covariance , the log-likelihood is a quadratic form — the celebrated plus a determinant term — the workhorse for supernova distances, BAO, and high- CMB bandpowers.
where: — data vector (measured bandpowers, distances, correlation functions); — theory prediction from the Boltzmann code; — data covariance matrix. When is independent of the second term is constant and maximizing is exactly minimizing . The model that supplies is, in its base form, remarkably economical: six numbers. The choice of which six matters — these are the combinations the CMB measures most cleanly, minimizing correlations in the fit.
where: — physical baryon and cold-dark-matter densities (peak ratios and heights fix them); — angular size of the sound horizon at last scattering (peak positions); — optical depth to reionization; — amplitude and tilt of the primordial power spectrum. Everything else — , , , the age of the Universe — is a derived function of these six. To forecast a survey, or read off the local shape of the posterior, one uses the Fisher information matrix — the expected curvature of the log-likelihood at the peak, whose inverse bounds the achievable errors through the Cramér–Rao inequality.
where: — Fisher information matrix element; — the -th parameter; — marginalized variance forecast for parameter . The marginalized error is always the conditional error ; equality holds only when parameter is uncorrelated with all the rest. The reason the CMB cannot fix by itself is captured in one geometric relation: the acoustic peaks measure the ratio of a physical length to a distance, and that single number is what recombination stamps on the sky.
where: — comoving sound horizon at recombination, ; — comoving angular-diameter distance to last scattering; — Hubble parameter, set by the Friedmann equation . Because is a ratio, a whole curve of values reproduces it — the geometric degeneracy, and fitting BAO and supernova distances to this integral is what breaks it and constrains and the dark-energy equation of state. Late-time structure probes report a different combination — clustering amplitude weighted by how much matter there is to cluster. Weak lensing is sensitive not to alone but to this product.
where: — rms linear matter fluctuation in spheres; — present matter density. runs along the – degeneracy that lensing leaves, so it is the quantity a lensing survey measures well. Finally, deciding whether an extended model is warranted is a question of evidence, not best fit — the Bayes factor is the ratio of evidences, with an automatic Occam penalty.
where: — evidences of models 1 and 0 (e.g. CDM vs ΛCDM); — the odds ratio, read on the Jeffreys scale. A model with an extra parameter must fit enough better to overcome the prior volume it wastes, or will favour the simpler model.
The goal is to show precisely why parameter estimation so often reduces to minimizing a , and where that shortcut is legitimate. We assume the data are drawn from a multivariate Gaussian centred on the theory prediction, and track what happens to the normalization when the covariance does — or does not — depend on the parameters. This matters because a covariance that secretly depends on (as the cosmic-variance part of the CMB does) adds a determinant term that a naive silently drops.
Step 1. Write the residual as a multivariate Gaussian, . Why: the central limit theorem makes binned data approximately Gaussian, and carries every correlation — noise, cosmic variance, survey geometry.
Step 2. Take of both sides: . Why: the log turns the exponential into a quadratic form we can differentiate, and becomes an additive .
Step 3. If is independent of , the determinant is constant and drops out of any -derivative, so maximizing equals minimizing . Why: this is the license behind every "we minimize " — exact only when the errors do not depend on the model, true for SNe and BAO.
Step 4. When , keep the determinant: the correct estimator balances fit against model-dependent noise. Why: this is why the low- CMB needs an exact likelihood — the variance of each multipole is proportional to itself. *Verified: reduces to for parameter-independent ; the term is retained for cosmic-variance-limited data. Standard (Dodelson, Modern Cosmology Ch. 14; Verde 2010).*
Go deeper · Derivation B · 1 minThe Fisher matrix and the Cramer-Rao forecast
The aim is to derive the fastest, most widely used tool for predicting how well a future experiment will measure parameters before a single photon is collected. We expand the log-likelihood to second order about its maximum, identify the Gaussian's covariance with the inverse curvature, and average over data realizations to get the expected information. The payoff is a recipe — build from derivatives of the theory spectra, invert, read off forecasted errors — plus the Cramér–Rao bound that no unbiased method can beat.
Step 1. Taylor expand about the maximum-likelihood point : , with no linear term. Why: at a maximum the gradient vanishes, so the leading behaviour is the quadratic curvature — the posterior looks locally Gaussian no matter how non-Gaussian it is globally.
Step 2. Read off a Gaussian posterior with precision matrix , whose covariance is . Why: a Gaussian's inverse-covariance is precisely its curvature, so the Hessian of the log-likelihood already contains the full error ellipse, including all parameter correlations.
Step 3. Average the Hessian over data realizations, , to get the Fisher information — the expected curvature, which needs only a fiducial model, not real data. Why: this is what makes forecasting possible; you assume a truth, compute how sharply an idealized dataset would peak around it, and you have predicted the survey's power in advance.
Step 4. State the Cramér–Rao bound , so the best marginalized error is , always . Why: inverting the full matrix and taking the diagonal marginalizes over the other parameters, and the inequality is the mathematical form of "correlations inflate error bars" seen in the second figure. *Verified: standard result; Dodelson Ch. 14, Tegmark, Taylor and Heavens (1997). For a Gaussian likelihood, , which for CMB spectra becomes a sum over weighted by .*
Go deeper · Derivation C · 2 minThe geometric degeneracy and why BAO breaks it
This explains the single most important reason the field combines datasets: the CMB, for all its precision, measures only one geometric number well and cannot separate from on its own. We fix the early-Universe physics that sets the sound horizon, show the distance to last scattering can be traded against at constant , then introduce the low-redshift standard ruler that measures the same scale from a different vantage, crossing the degenerate line and pinning both parameters.
Step 1. The pre-recombination physics fixes the comoving sound horizon , which depends only on and . Why: the baryon-photon sound speed and the expansion rate before recombination are set by the physical densities, which the CMB damping tail and peak-height ratios nail down independently of the late-time expansion.
Step 2. The observed angle is with ; holding and fixed forces constant, which a whole family of pairs achieves. Why: with fixed, raising lowers and raises in a coordinated way that leaves the distance integral unchanged — this is the degenerate direction, the long amber sliver in the first figure.
Step 3. Along that curve the entire CMB spectrum is nearly invariant, so the CMB alone cannot split from ; in flat ΛCDM the late-time ISW effect and lensing partly lift it, but curvature or dynamical dark energy reopen it fully. Why: this is why a "CMB-only " quietly assumes flatness and a cosmological constant — relax those and the constraint balloons.
Step 4. BAO measures at –, the same sound-horizon scale imprinted in galaxy clustering, giving a second constraint in the plane that crosses the CMB line. Why: because BAO reads at low redshift where the distance–density relation is different, its band cuts across the degeneracy — the blue band in the first figure — and their intersection fixes both parameters at once. *Verified: consistent with Planck 2018 (A&A 641, A6) degeneracy-breaking analysis; the acoustic-scale numbers are reproduced in Worked Example 2.*
Limiting cases
Different data regimes call for genuinely different statistical treatments — the same Bayes theorem, but a different likelihood shape.
| Case | Result | Meaning |
|---|---|---|
| High- CMB / many modes | Many modes per band; the central limit theorem makes the bandpower likelihood approximately Gaussian, with the bandpower covariance. | |
| Low- CMB / few modes | Only modes exist; cosmic variance dominates and the exact inverse-Wishart form is mandatory, not a Gaussian in . | |
| Gaussian posterior (strong data) | Near a sharp peak the Fisher matrix captures the full posterior; errors saturate the Cramér–Rao bound and forecasts are reliable. | |
| Weak / prior-dominated | When data barely constrain a parameter (e.g. without low- polarization), the posterior tracks the prior and reported bounds reflect assumptions, not measurement. |
Worked examples
1 · How correlation inflates a marginalized error (fully worked)
Two parameters have a Fisher matrix (in units where the diagonal is ). Find the conditional error on (all else fixed), the marginalized error, and the inflation factor.
Step 1. The conditional error freezes and uses only the diagonal curvature: . This is the width of a vertical slice through the peak — the narrow red bar in the second figure.
Step 2. The marginalized error requires inverting . The determinant is , so and .
Step 3. The inflation factor is . Cross-check against the correlation: the covariance correlation coefficient is , and . The two routes agree exactly.
Step 4. Interpretation: a correlation between two parameters more than doubles the honest error bar on either one. This is why breaking a degeneracy with a second probe, which drives toward zero, is worth more than collecting more of the same data. σ_cond = 0.10, σ_marg = 0.229, inflation = 2.29 at ρ = 0.9.
2 · The acoustic scale, from length and distance to a peak position (fully worked)
Using the Planck comoving sound horizon and comoving distance to last scattering , compute , the reported , and the acoustic multipole . Compare to Planck's .
Step 1. The angle is a pure ratio: . In more familiar units that is — the physical size of the sound horizon subtends about a third of a degree on the sky.
Step 2. The quantity actually reported is , matching the Planck value to four significant figures — a measurement good to about , one of the most precise numbers in cosmology.
Step 3. The acoustic scale in multipole space is . This sets the harmonic spacing of the CMB peaks; the first peak sits lower, near , because gravitational driving and the early ISW effect shift it, but the comb spacing is governed by .
Step 4. The degeneracy made numerical: this exquisite number constrains only the ratio . Hold it fixed and slide from toward — with pinned, falls from to while readjusts to keep fixed. The CMB cannot tell these universes apart; BAO, measuring the same at , can. 100θ_* = 1.0411 (Planck 1.04109), ℓ_A = 301.8.
3 · Quantifying the S_8 tension (fully worked)
Planck 2018 gives and . Compute . Given a weak-lensing value (KiDS-1000-like) and a Planck value , quantify the tension.
Step 1. Evaluate the definition: . The combination is designed so that lensing surveys, which trail along the – banana, report with a much smaller error than either factor alone.
Step 2. The discrepancy is ; treating the measurements as independent, , so the tension is — the milder of the two, with late-time surveys seeing less clustering than the CMB extrapolates.
Step 3. For contrast, the Hubble constant — Planck against a distance-ladder — gives , the ~ Hubble tension. Parameter estimation is the arena where extended models are tested to see if they lower one tension without raising the other. S_8 = 0.832, S_8 tension ≈ 2.7σ, Hubble tension ≈ 4.9σ.
Physics of the portrait
Cosmological parameter estimation has no single inventor because it is a confluence: an eighteenth-century theorem of inverse probability, a twentieth-century theory of statistical information, a mid-century sampling trick born of the hydrogen bomb, and a turn-of-the-millennium flood of precision data. The portrait below is of the method itself, the way the refractive-index portrait was of a number seen three ways.
Origins · 1 mincosmological parameter estimation and how this was discovered
The method rests on a theorem published in 1763, two years after Thomas Bayes died, when his friend Richard Price read "An Essay towards solving a Problem in the Doctrine of Chances" to the Royal Society — the first statement of how evidence updates belief. Pierre-Simon Laplace independently rediscovered and vastly extended inverse probability, using it to estimate the mass of Saturn from orbital data. For over a century the machinery lay largely unused for physics until Ronald Fisher, in the 1920s, built the modern theory of estimation — the likelihood function, maximum-likelihood estimators, and the information that bears his name, whose inverse (with the 1940s Cramér–Rao bound) floors any measurement. The computational half arrived in 1953, when Metropolis, the Rosenbluths and the Tellers devised Monte Carlo sampling at Los Alamos — the algorithm that, generalized by Hastings in 1970, became the MCMC that samples cosmological posteriors today. The synthesis came in the 1990s: Tegmark, Taylor and Heavens (1997) showed how a Fisher matrix forecasts what a CMB experiment will measure, guiding the design of WMAP. When WMAP (2003) and then Planck (2018) delivered all-sky data, the same pipeline — Boltzmann code, likelihood, MCMC, marginalization — turned photographs of the infant Universe into a six-number table quoted to sub-percent precision. What Bayes began as a philosophical puzzle is now the instrument that reads the contents of the cosmos.
Going further
Texts. Dodelson, Modern Cosmology, 2nd ed., Ch. 11 (Probes of Inhomogeneities) and Ch. 14 (Data Analysis) · Ryden, Introduction to Cosmology, 2nd ed., Ch. 8–9 · Carroll and Ostlie, An Introduction to Modern Astrophysics, 2nd ed., Ch. 29–30 · Mo, van den Bosch and White, Galaxy Formation and Evolution, Ch. 6 · Verde, "Statistical methods in cosmology", Lect. Notes Phys. 800 (2010).
Provenance. Parameter values are Planck 2018 TT,TE,EE+lowE+lensing (Planck Collaboration 2020, A&A 641, A6): , , , , , , , . Bayes' theorem, the Gaussian likelihood, and the Fisher/Cramér–Rao results are textbook (Dodelson Ch. 14; Tegmark, Taylor and Heavens 1997; Verde 2010). The acoustic-scale figures ( Mpc, Mpc, , ), , and the tension magnitudes (Hubble , ) are recomputed in the worked examples from the Planck values and representative late-time datasets.
Prerequisites. The ΛCDM Concordance Model · The CMB Anisotropy Power Spectrum · Transfer Function and the Matter Power Spectrum · The Primordial Power Spectrum · The Sound Horizon and the Standard Ruler. Leads to. Baryon Acoustic Oscillations · Dark Energy and the Cosmological Constant · Cold Dark Matter.
Ask the tutor: Want to walk through how a real MCMC chain turns Planck bandpowers into the – contour, step by step?
What exactly is the difference between the likelihood and the posterior?
The likelihood is the probability of the data for fixed parameters — evaluated by running the Boltzmann code and comparing to the measurements. The posterior is the probability of the parameters given the data you have, and it is what you want; Bayes' theorem connects them as posterior = likelihood × prior, normalized. The distinction matters because the likelihood is not a probability distribution over at all — you cannot integrate it over parameters and get one — whereas the posterior is, which is why error bars, credible intervals and marginalization are all posterior statements.
Why sample with MCMC instead of just gridding the parameter space?
Because the curse of dimensionality is brutal. A grid with 20 points per axis in the base six-parameter model already needs likelihood evaluations, each running a Boltzmann code — infeasible, and hopeless for the fifteen-plus parameters of a realistic analysis with nuisances. MCMC instead spends effort only where the posterior has support: it random-walks through parameter space, accepting or rejecting steps so the density of visited points converges to the posterior. The sample count scales roughly linearly with dimension rather than exponentially, and the chain yields marginalized constraints by simply histogramming the coordinates you care about.
What is the geometric degeneracy in plain terms?
The CMB acoustic peaks are a comb whose spacing is set by one angle, — the apparent size on the sky of the sound horizon, the farthest sound could travel before recombination. That angle is a ratio: a physical length divided by the distance to last scattering. Many universes share the same ratio, because at fixed early-Universe physics you can trade the Hubble constant against the matter density and keep unchanged. So the CMB measures the combination superbly but leaves a long thin valley in the – plane, which a second ruler at low redshift, like BAO, crosses to fix both.
Are the Hubble and S_8 tensions signs of new physics or just mistakes?
Nobody knows yet, which is why they are the field's central questions. Both possibilities are live. On the systematics side, the distance ladder involves Cepheid calibration and metallicity corrections, and weak lensing involves photometric redshifts and intrinsic alignments — any could bias the late-time numbers. On the new-physics side, early dark energy can raise the CMB-inferred by shrinking the sound horizon, and modified growth can lower . The trouble is that no single simple extension relieves both tensions at once without spoiling some other well-measured quantity, and Bayes factors so far do not decisively favour any over base ΛCDM. Resolving it will likely take the next generation of independent data.
Why are there exactly six base parameters, and where did the others go?
The six are a minimal spanning set: two physical densities (, ), one geometric angle (), one reionization depth (), and two for the primordial spectrum (, ), chosen because the CMB measures these combinations with the least correlation. Everything else quoted — , , , the age of the Universe — is derived: a deterministic function of the six, computed at every chain point. Parameters like curvature , the equation of state , the neutrino mass, or are held at their ΛCDM defaults and only added to test an extension, at which point the Bayes factor judges whether the data justify the extra freedom.
When is it safe to use a Fisher matrix instead of a full MCMC?
The Fisher matrix assumes the posterior is Gaussian — a single elliptical peak — so it is trustworthy when the data constrain parameters strongly and the likelihood is smooth near its maximum, which is common for well-measured parameters and for forecasting idealized surveys. It is fast, transparent, and exposes degeneracy directions cleanly. It fails, sometimes badly, when the posterior is non-Gaussian: hard prior boundaries (a positive neutrino mass, near zero), banana-shaped degeneracies, or multimodal likelihoods, where the Fisher error can be off by large factors and only a full MCMC gives honest contours. Use Fisher for survey design and intuition, MCMC for any number you intend to publish.
What does the Bayesian evidence add that the best-fit chi-squared does not?
The best-fit tells you how well a model can fit if tuned optimally, but it always improves when you add parameters — a more flexible model fits noise better, so raw goodness-of-fit rewards complexity. The evidence instead averages the likelihood over the whole prior volume, penalizing a model for all the prior space where its extra parameter does nothing useful. This is Occam's razor made quantitative: an extension must fit enough better to repay the volume it wastes. The Bayes factor , read on the Jeffreys scale, tells you whether the data actually prefer CDM over ΛCDM, not merely whether CDM can fit.