The S8 / σ8 Tension
The concordance cosmology tells a two-act story about how the Universe grew clumpy. In the first act, at recombination, the CMB anisotropy power spectrum fixes the primordial amplitude of curvature perturbations and the matter density ; in the second, the linear growth of structure and the transfer function play those seeds forward under CDM to a definite prediction for how strongly matter should cluster today. The number summarising "today's clumpiness" is , the rms linear density contrast smoothed on spheres of comoving radius . The tension is the finding that low-redshift probes — above all weak gravitational lensing, or cosmic shear — measure a value slightly below what the CMB, extrapolated forward, predicts. The parameter that makes the comparison sharp is not itself but . Weak lensing cannot separate "how much matter" from "how clumpy" — a lot of smooth matter deflects light much like a little clumpy matter — so its constraints run along a banana-shaped degeneracy of nearly constant , and collapsing that ridge onto its well-measured direction is exactly what does. Planck 2018 gives ; KiDS-1000 and DES Y3 cluster near –. That offset is a – discrepancy — modest, systematics-limited, unlike the sharper Hubble tension — yet persistent enough to be treated as a real crack worth watching in the otherwise triumphant CDM picture.
- The tension is a mild (–) disagreement in the amplitude of matter clustering: the CMB extrapolated to under CDM predicts more clumping than low-redshift weak lensing measures.
- The clean comparison variable is — the combination lensing constrains best, orthogonal to the – degeneracy.
- Numbers: Planck 2018 gives ; KiDS-1000 gives and DES Y3 gives — a pull.
- The significance is systematics-limited: baryonic feedback, intrinsic alignments, photometric-redshift errors, and non-linear modelling each move at the percent level, comparable to the tension itself.
- Physically, a low at fixed early-Universe seeds means late-time growth ran slow — inviting modified gravity, interacting or free-streaming dark matter, or dynamical dark energy, though none yet beats CDM.
- is the late-time counterpart of the primordial amplitude : it tests the integrated growth of structure across nearly the whole history of the Universe.
- Key idea: the CMB fixes the primordial amplitude and lets CDM predict today's clustering; weak lensing measures it directly, and their values of differ mildly, hinting that either late-time growth is suppressed or lensing systematics are underestimated.
The CMB fixes the primordial amplitude and lets CDM predict today's clustering; weak lensing measures it directly. Their preferred values of differ mildly, hinting that either late-time growth is suppressed or lensing systematics are underestimated.
Where this lives today
The tension is one of two headline anomalies driving observational cosmology into the mid-2020s, alongside the sharper Hubble tension. Stage-IV weak-lensing surveys are built to settle it: the Euclid satellite, launched in 2023, and the Vera C. Rubin Observatory's LSST each map cosmic shear over thousands of square degrees with tomographic redshift binning, shrinking the statistical error on well below the size of the tension and forcing the question onto systematics — feedback, intrinsic alignments, photometric-redshift calibration. In parallel, CMB-lensing from ACT and SPT, cross-correlated with galaxy surveys, localises where in cosmic history any growth suppression sets in; strikingly, the ACT DR6 and Planck CMB-lensing amplitudes come out consistent with the high, CMB-predicted , pushing the discrepancy toward the low-redshift shear regime and its astrophysics. Redshift-space distortions from DESI and Euclid deliver , an independent growth-rate handle. Notably, the tension has been softening: joint KiDS-plus-DES reanalyses land near , and improved feedback and redshift modelling nudge shear values upward — so the honest verdict remains that is a suggestive crack, not yet a broken model.
The physical picture
Think of the primordial power spectrum as a catalogue of seed fluctuations, photographed by the CMB at . CDM plays those seeds forward with a growth rate that linear theory computes exactly, and is a snapshot of how tall the resulting weeds have grown today on scales. The tension is that the CMB predicts slightly taller weeds than the lensing surveys see growing — the low-redshift ground looks a touch smoother than the early-Universe model insists. The trouble is that weak lensing does not measure and separately: the shear imprinted on background galaxies depends on the total deflecting mass along the line of sight, and a smooth-but-abundant matter field mimics a clumpy-but-sparse one. So the constraint is a banana-shaped ridge of nearly constant , and only the direction across it — the combination — is pinned down. The first figure is that coordinate rotation made visible: the lensing banana, the Planck point sitting above it, and the axis along which the two disagree.
The scale is historical, not fundamental — it is where the rms fluctuation in galaxy counts was famously found to be of order unity, a convenience of the 1980s that stuck. It also sits awkwardly on the boundary between linear and mildly non-linear scales, which is exactly why baryonic feedback and non-linear modelling loom so large here: the integral draws most of its weight from the wavenumbers where astrophysics is messiest. The second figure is the plot cosmologists actually draw — the ladder of measured values, Planck's prediction as a band and the lensing surveys sitting stubbornly to its left.
The core equations
The whole subject rests on one definition. Weak lensing measures a projected, degenerate blend of density and clustering, so cosmologists rotate coordinates to the direction that lensing constrains sharply — and give it a name.
where: — the clustering-amplitude parameter cosmic shear measures best; — rms linear density contrast smoothed on ; — present-day matter density, pivoted at so near the fiducial cosmology. Reading it: is tilted toward , so a lensing survey pins one number instead of a smear. The quantity is itself an integral over the matter power spectrum, filtered by a real-space top-hat sphere of radius . Its variance is the power spectrum weighted by the squared window transform.
where: — variance of smoothed on scale , with giving ; — linear matter power spectrum today; — Fourier transform of the top-hat; — comoving wavenumber. Reading it: counts power across all scales, but the window decides which scales contribute. The window is the transform of a uniform sphere: it passes long-wavelength modes intact and rolls off once the wavelength drops below the sphere.
where: — dimensionless product of wavenumber and smoothing radius; — normalised to , falling as for . Reading it: for and suppresses , so is dominated by – — the awkward mildly-non-linear band. The power spectrum itself factorises into a primordial piece fixed by the CMB and a late-time growth piece computed by CDM — where the two acts of the story meet.
where: — primordial scalar amplitude, fixed by the CMB; — scalar spectral index; — transfer function encoding sub-horizon growth and radiation drag; — linear growth factor, normalised to today. Reading it: the CMB sets and ; everything late-time lives in . Because linear growth is scale-independent, every Fourier mode grows by the same factor, so tracks — the lever by which late-time physics moves the prediction.
where: — clustering amplitude at scale factor ; — linear growth factor; — its value today. Reading it: suppress growth at late times and you lower , hence today's and — the physical route to easing the tension. What lensing observes is a projected line-of-sight integral of this power spectrum weighted by a geometric efficiency kernel. In the Limber approximation each multipole samples one wavenumber per distance shell.
where: — angular power spectrum of the lensing convergence; — comoving distance ( the horizon); — lensing efficiency kernel, ; — multipole. Reading it: the signal scales as (kernel)(power) , which is where the degeneracy — and hence — comes from. Finally, the tension is quantified by a simple sigma metric comparing the CMB and lensing values against their combined error.
where: — number of sigma of discrepancy; — the two central values; — their errors. Reading it: for KiDS-1000 versus Planck this returns — real, but far short of the discovery bar.
The goal is to show, from the projected shear power spectrum, that weak lensing constrains not and separately but a specific power-law blend of them close to — motivating as the one number a shear survey can quote and compare cleanly against the CMB. We track how the two parameters enter the observable, combine their scalings, and account for why the naive exponent flattens in a real survey.
Step 1. The lensing efficiency kernel scales as , where is a purely geometric source-distance factor. Why: gravitational deflection is sourced by the matter density itself, so the strength of the shear signal is proportional to through the amount of deflecting mass along the line of sight.
Step 2. At fixed spectral shape, the amplitude of the matter power spectrum scales as , since is by construction the rms of the linear field. Why: is a normalisation of , so doubling the clustering amplitude quadruples the power and hence the shear variance.
Step 3. Insert both into the Limber integral: , so the constant-signal locus is . Why: the observable is quadratic in the kernel and linear in the power, so its amplitude depends only on the product to leading order, which is a degenerate ridge in the – plane.
Step 4. A full likelihood integrates over many multipoles and tomographic redshift bins, where the shape of , the growth history, and the geometric factor each carry extra, weaker dependence, flattening the fitted exponent in from toward . Why: holds only for a single scale and source plane; averaging over the survey's range dilutes the density dependence.
Step 5. Adopt and pivot at to define , measured to a few percent and orthogonal to the residual degeneracy. Why: this is the eigen-direction of the lensing likelihood, so quoting discards no constrained information while making cross-survey comparison unambiguous.
Go deeper · Derivation B · 1 minAssembling sigma-8 from the power spectrum and the top-hat window
The goal is to build explicitly from the linear power spectrum and the top-hat filter, exposing why the fiducial scale is delicate: the variance integral draws its weight from wavenumbers straddling the linear-to-non-linear transition, precisely where baryonic astrophysics is hardest to model. We reduce the variance to a one-dimensional integral by isotropy, examine the window cutoff, and read off the sensitivity.
Step 1. The smoothed density field has variance , the power spectrum weighted by the squared window transform. Why: smoothing in real space is multiplication by in Fourier space, so the variance of the filtered field is times integrated over all modes.
Step 2. Angular integration over the sphere in -space collapses the to a radial integral, giving . Why: for a statistically isotropic field and depend only on , so and .
Step 3. The top-hat window satisfies for and falls as for , so with the integrand peaks around –. Why: the filter passes fluctuations larger than the sphere and averages away those smaller than it, concentrating the variance in a band that unfortunately overlaps the onset of non-linear clustering.
Step 4. Substituting factorises the result as . Why: this cleanly separates the CMB-fixed amplitude and the late-time growth from a pure shape integral, showing that carries both primordial and growth information — exactly the two acts the tension compares.
Step 5. Because the dominant range is mildly non-linear, baryonic feedback that suppresses there by up to shifts the inferred by a few percent. Why: , so a suppression over the contributing band moves by several percent — comparable to the tension itself, which is why feedback modelling is make-or-break.
Limiting cases
How and the tension behave in the regimes that bound the problem:
| Case | Result | Meaning |
|---|---|---|
| Perfect early-late consistency | CDM passes: growth from to matches the CMB extrapolation. This is the null hypothesis the data mildly violate. | |
| Suppressed late growth | Modified gravity or interacting dark energy weakens clustering after matter- equality, lowering the observed without touching the CMB peaks. | |
| Linear vs non-linear scale | Here is non-linear and baryonic feedback suppresses power up to ; mis-modelling biases the inferred comparably to the tension. | |
| Lensing degeneracy limit | (approx.) | Shear power scales roughly as , so only the combination is well measured; alone stays degenerate. |
Worked examples
1 · From Planck's chain to the tension significance (fully worked)
Planck 2018 reports and for base CDM. Compute the implied , then quantify its tension with KiDS-1000, which measures .
Step 1. Apply the definition with the Planck central values: . This gives , consistent with Planck's directly reported (the small difference reflects full-chain marginalisation rather than plugging in central values).
Step 2. Form the tension metric of equation (7). Take and, for the asymmetric KiDS error, . The offset is .
Step 3. Combine the errors in quadrature: . Then . So the KiDS-1000 versus Planck tension is — a genuine pull, but comfortably below the threshold at which cosmologists would call it a discovery rather than a hint.
2 · How much must late-time growth slow to close the gap? (fully worked)
Suppose the tension is entirely physical, caused by a mode-independent suppression of the linear growth factor at low redshift. By what fraction must fall below its CDM value, and roughly when would that suppression have to act?
Step 1. Because linear growth is scale-independent, and therefore at fixed primordial amplitude. The required rescaling is just the ratio of the measured to the predicted value: .
Step 2. Evaluate: . So must sit about below the CDM growth the CMB predicts. This is a small number — new physics need not overturn the growth history, only trim its final stretch by a few percent.
Step 3. The suppression must switch on after the CMB is imprinted and largely after matter- equality (), since BAO distances and the CMB peaks already agree with CDM and must not be disturbed. A late-onset growth suppression below is the target any physical resolution must hit — enough to lower , little enough to leave the well-measured geometry alone. This is exactly the window dynamical dark energy, weak fifth forces, and decaying-dark-matter models try to exploit.
Physics of the portrait
has no single discoverer, but the statistic it is built from — the variance of galaxy counts in spheres — and the whole machinery of comparing clustering amplitudes to a growth prediction descend directly from one person, who turned cosmic structure from a qualitative story into a quantitative science.
Origins · 1 minJames Peebles and how this was discovered
Phillip James Edwin Peebles built the statistical language in which the tension is even stated. Beginning in the 1960s at Princeton, he treated the galaxy distribution not as a catalogue of objects but as a random field, introducing the two-point correlation function with and its Fourier partner, the power spectrum . His 1980 monograph The Large-Scale Structure of the Universe codified the variance-in-spheres statistic, and the 1983 analysis with Marc Davis established that the rms galaxy-count fluctuation is of order unity averaged over spheres of radius — the very reason that peculiar scale, and the symbol , became the field's standard clustering normalisation. Peebles also derived the linear growth equation in an expanding universe, computed early transfer functions with Yu, and was among the architects of cold dark matter, the framework whose late-time growth prediction the tension now tests. His 2019 Nobel Prize recognised precisely this transformation of cosmology into a precision, statistics-driven science; the modern comparison of a CMB-anchored against a directly measured one is his program carried to its natural, and now slightly uncomfortable, conclusion.
Going further
Texts. Ryden, Introduction to Cosmology, 2nd ed., Ch. 12 (structure formation, ) · Dodelson, Modern Cosmology, 2nd ed., Ch. 7–9 (power spectrum, growth, lensing) · Carroll & Ostlie, An Introduction to Modern Astrophysics, 2nd ed., Ch. 30 (cosmic structure) · Mo, van den Bosch & White, Galaxy Formation and Evolution, Ch. 4 & 6 (perturbation growth, statistics) · Binney & Tremaine, Galactic Dynamics, 2nd ed., Ch. 9 (perturbation growth) · Planck 2018 results VI, A&A 641, A6 (2020) · Heymans et al., KiDS-1000, A&A 646, A140 (2021) · DES Y3, Phys. Rev. D 105, 023520 (2022). The key numerical anchors are: Planck 2018 , , ; KiDS-1000 ; DES Y3 . The tension arithmetic gives , and the implied growth ratio is .
Prerequisites. Density Perturbations and the Density Contrast · Linear Growth of Structure · Transfer Function and the Matter Power Spectrum · The Primordial Power Spectrum · The CDM Concordance Model. Leads to. Dark Energy and the Cosmological Constant · Cold Dark Matter · The CMB Anisotropy Power Spectrum.
Ask the tutor: Ask me to walk through why cosmic shear can only pin down and not and separately, or to work a growth-suppression model that lowers without disturbing the CMB.
Is the S-8 tension the same kind of problem as the Hubble tension?
No, though they are cousins. Both compare an early-Universe CDM extrapolation from the CMB against a direct low-redshift measurement, and both find the late-Universe value on the "quieter" side — a lower expansion rate eases , and lower growth eases . But the Hubble tension is sharp, roughly , and resistant to any single systematic, which is why it dominates attention. The tension is milder, –, and genuinely systematics-limited: baryonic feedback and photometric redshifts can each move it by the size of the effect. So is treated as suggestive corroboration rather than an independent smoking gun, and a model resolving both at once would be far more compelling than one touching only .
Why is the pivot 0.3 and the exponent 0.5 in the definition of S-8?
Both are conventions, not physics. The exponent approximates the slope of the weak-lensing degeneracy: shear power scales roughly as for a single scale and source plane, which suggests an exponent of , but averaging over a real survey's multipoles and redshift bins flattens the best-constrained direction to about — and different surveys sometimes fit slightly different exponents. The pivot is cosmetic: it centres near for the concordance cosmology so the number reads near unity. Neither choice is fundamental; they exist so one clean number captures what lensing actually measures.
Could the tension just be baryonic feedback rather than new physics?
Very possibly — this is the leading mundane explanation. The integral draws most of its weight from –, where feedback from active galactic nuclei and supernovae blows gas out of halos and suppresses the small-scale matter power spectrum by up to . Since , mismodelling that suppression can bias the inferred by several percent — the whole size of the tension. Analyses that marginalise more aggressively over feedback, or discard the most non-linear scales, tend to nudge shear upward toward Planck. Disentangling feedback from genuine growth suppression is exactly why Stage-IV surveys pair shear with X-ray, kinetic Sunyaev-Zel'dovich, and CMB-lensing cross-correlations.
Does a low S-8 mean the CMB is wrong?
No. The CMB directly measures the early-Universe amplitude and the matter density from the acoustic peaks, and those measurements are extraordinarily robust. What it reports as is not an early-Universe observable but a CDM forward extrapolation: it takes the CMB-fixed initial conditions and integrates to today. A low lensing therefore points to one of two things — either late-time growth genuinely ran slow, so the extrapolation and not the CMB is at fault, or the lensing measurement is biased low by systematics. Tellingly, CMB-lensing amplitudes from Planck, ACT, and SPT sit high, consistent with the extrapolation, sharpening suspicion on the low-redshift shear regime.
What is the difference between sigma-8 and f-sigma-8, and why measure both?
is the amplitude of clustering — how tall the density fluctuations are today. The combination multiplies it by the linear growth rate , and it is what redshift-space distortions measure: peculiar velocities, which distort the observed clustering in redshift space, are sourced by while their scale is set by . Measuring both matters because they probe growth differently — from lensing integrates growth up to now, whereas from spectroscopic surveys is a snapshot of its instantaneous rate at each redshift. New physics that suppresses late-time growth should leave correlated fingerprints in both, but they carry independent systematics, so agreement between them strengthens any claim considerably.
Why not just quote sigma-8 and Omega-m separately and be done with it?
Because weak lensing does not measure them separately — it measures a blend. The shear signal depends on the combination , so any survey's likelihood is a long banana in the – plane rather than a tight blob. Quoting alone would force you to fix by a prior, and two surveys with different priors would report different even if their data agreed perfectly. is the projection onto the short axis of the banana — the one direction the data actually constrain — so it is reproducible across surveys and cleanly comparable to the CMB: the honest summary of what lensing knows and does not know.