The Cosmological Constant and Dark Energy

Roughly seven parts in ten of the universe is invisible, weightless in the ordinary sense, and pushing the cosmos apart. This is dark energy, and its simplest and best-fitting description is the oldest term in cosmology — Einstein's cosmological constant $\Lambda$ , revived. The chapter's earlier articles built the machinery: the Friedmann equations that govern the scale factor, the equation of state $w=p/\rho$ that labels each cosmic fluid, the critical density, and the FLRW metric. This article puts a single strange fluid through that machinery — a component with $w=-1$ , an energy density that does not thin as space grows — and follows the consequences to their end. The physics turns on one fact with no Newtonian analogue: pressure gravitates, and the source of cosmic deceleration is $\rho+3p$ , not $\rho$ . Give a fluid a pressure as negative as its energy density is positive, and that combination flips sign; gravity, for that component, repels. Because such an energy density never dilutes while matter falls as $a^{-3}$ , a constant $\Lambda$ is destined to win — however small it starts, it eventually dominates and the expansion accelerates toward de Sitter growth. Observation forced the issue in 1998, when two teams tracking distant Type Ia supernovae found them fainter, hence farther, than any decelerating universe allowed. Combined with the flat geometry the cosmic microwave background demands and the clustering baryon acoustic oscillations trace, the data settled on $\Lambda$ CDM: about 69% dark energy, 26% cold dark matter, 5% baryons. Whether that 69% is a true constant or a slowly rolling field is the open question this article ends on — and beneath it lies the cosmological constant problem, the worst quantitative prediction in physics.

Key takeaways

Dark energy is the smooth component driving the accelerated expansion of the universe; its simplest form is the cosmological constant $\Lambda$ , a vacuum energy with density $\rho_\Lambda=\Lambda/(8\pi G)$ and equation of state $w=-1$ .
In the acceleration equation the source is $\rho+3p$ ; the vacuum's $p=-\rho$ gives $\rho+3p=-2\rho_\Lambda<0$ , so a positive energy density produces repulsion and $\ddot a>0$ .
Vacuum energy is $\rho_\Lambda\propto a^0$ — it never dilutes — while matter falls as $a^{-3}$ and radiation as $a^{-4}$ , so $\Lambda$ inevitably comes to dominate; with $\Omega_\Lambda\approx0.685$ it overtook matter near $z\approx0.30$ and acceleration began earlier, at $z\approx0.63$ .
A $\Lambda$ -dominated flat universe approaches de Sitter space, $a\propto e^{H_\Lambda t}$ with $H_\Lambda=\sqrt{\Lambda/3}\to55.8\ \mathrm{km\,s^{-1}\,Mpc^{-1}}$ , walling every observer inside a finite event horizon at $\approx17.5$ Gly.
The 1998 Type Ia supernova surveys, CMB flatness, and baryon acoustic oscillations independently require $\Omega_\Lambda\approx0.69$ and $w\approx-1$ ; 'quintessence' generalizes $\Lambda$ to a dynamical field with $w(a)=w_0+w_a(1-a)$ .
Quantum field theory predicts a vacuum energy about $10^{120}$ times the observed $\rho_\Lambda\sim(2\ \mathrm{meV})^4$ — the unsolved cosmological constant problem.
Key idea: A constant energy density with negative pressure, $w=-1$ , neither dilutes nor redshifts as space expands; once it dominates it makes gravity effectively repulsive and the universe accelerates toward de Sitter expansion.

Where this lives today

Dark energy is now a measured quantity under assault by the largest surveys ever built, all aimed at one question: is $w$ exactly $-1$ , or does it drift? DESI maps tens of millions of galaxies to trace the expansion history through baryon acoustic oscillations; Euclid and the Vera Rubin Observatory's LSST add weak-lensing maps of dark matter, while the Nancy Grace Roman Space Telescope will push Type Ia supernovae past the 1998 samples. Everything remains consistent with $w=-1$ to a few percent — but DESI's oscillation results, combined with supernovae, have hinted at modest significance toward a time-varying equation of state, $w_0>-1$ with $w_a<0$ in the CPL form. If it survives, it would rival the original discovery. Layered on top is the Hubble tension — early- and late-universe determinations of $H_0$ disagree at several sigma — which keeps pressure on the whole $\Lambda$ CDM framework. The one number Einstein added and retracted now anchors both the concordance model and the frontier trying to break it.

The physical picture

Everything counterintuitive about dark energy follows from one line of general relativity that Newton never wrote: the deceleration of the universe is sourced by $\rho+3p$ , energy density plus three times pressure, because in a relativistic theory pressure carries weight. Ordinary matter has $p\approx0$ , so its source is $\rho>0$ and it slows the expansion. The vacuum energy of $\Lambda$ has $p_\Lambda=-\rho_\Lambda$ , so the combination becomes $\rho_\Lambda+3p_\Lambda=-2\rho_\Lambda<0$ : the sign flips, a positive energy density produces repulsive gravity, and the scale factor curves upward instead of down. Cosmic history is the story of when this sign change takes over. It must take over, and this is the second essential fact. As space expands, matter thins as $\rho_m\propto a^{-3}$ and radiation faster still as $\rho_r\propto a^{-4}$ , because expansion both dilutes particles and stretches their wavelengths. Vacuum energy does neither: making more space simply makes more vacuum, so $\rho_\Lambda\propto a^0$ . However subdominant $\Lambda$ once was, the ratio $\rho_\Lambda/\rho_m$ grows as $a^3$ without bound, and a late epoch of $\Lambda$ domination is inevitable. The first figure traces the scale factor across that handover — decelerating under matter, then accelerating under $\Lambda$ , with the inflection where $\ddot a$ changes sign.

Figure

The cosmic scale factor a(t): the matter era decelerates expansion (a ∝ t^2/3, curving down), then vacuum energy accelerates it (a ∝ exp Ht, curving up); the inflection where ä changes sign falls at a ≈ 0.61, z ≈ 0.63, while today sits at a = 1

Why the vacuum must have $p=-\rho$ is not a cosmological assumption but a symmetry theorem. Empty space looks identical to every inertial observer — you cannot measure your velocity relative to nothing — so its stress-energy must be built from the only rank-two tensor invariant under all Lorentz boosts, the metric itself: $T^{(\Lambda)}_{\mu\nu}\propto g_{\mu\nu}$ . Matching that to the perfect-fluid form forces the four-velocity coefficient $\rho+p$ to vanish, so $w=-1$ — fixed before any telescope. The remaining question is empirical: does the real dark energy honour $w=-1$ exactly? The second figure shows the observation that first pinned it — the Type Ia supernova Hubble diagram, where distant candles sit above any decelerating universe's curve.

Figure

The Type Ia supernova Hubble diagram: distance modulus versus redshift for a decelerating universe (Ω_m = 1) and an accelerating one (Ω_Λ = 0.7); distant supernovae land about 0.25 magnitudes fainter — farther — than deceleration predicts, the 1998 signature of dark energy

The core equations

The starting point is Einstein's equation carrying the extra term: $\Lambda g_{\mu\nu}$ is the one geometric object that can join $G_{\mu\nu}$ without spoiling energy-momentum conservation. Whether one reads $\Lambda$ as curvature of the vacuum or as vacuum energy is a choice of which side of the equals sign to write it on. With $c=1$ ,

G_{\mu\nu}+\Lambda g_{\mu\nu}=8\pi G\,T_{\mu\nu} \qquad (1)

where: $G_{\mu\nu}=R_{\mu\nu}-\tfrac12 R g_{\mu\nu}$ — Einstein tensor; $\Lambda$ — cosmological constant, units length $^{-2}$ ; $g_{\mu\nu}$ — metric; $T_{\mu\nu}$ — stress-energy of matter and radiation; $G$ — Newton's constant. Reading: $\Lambda$ curves spacetime even where $T_{\mu\nu}=0$ . Carry the term to the right and it becomes a stress-energy of the vacuum — nothing changes but the bookkeeping, which is the point: geometry and vacuum energy are the same object.

T^{(\Lambda)}_{\mu\nu}=-\rho_\Lambda\,g_{\mu\nu},\qquad \rho_\Lambda=\frac{\Lambda}{8\pi G},\qquad p_\Lambda=-\rho_\Lambda,\qquad w\equiv\frac{p_\Lambda}{\rho_\Lambda}=-1 \qquad (2)

where: $\rho_\Lambda$ — vacuum energy density; $p_\Lambda$ — vacuum pressure, a tension; $w$ — equation-of-state parameter. Reading: $w=-1$ is the operational definition of a cosmological constant; measuring $w$ tests whether dark energy really is $\Lambda$ . The acceleration (second Friedmann) equation carries the payoff: $\Lambda$ contributes a term of definite positive sign to $\ddot a$ .

\frac{\ddot a}{a}=-\frac{4\pi G}{3}\left(\rho+3p\right)+\frac{\Lambda}{3} \qquad (3)

where: $a(t)$ — scale factor; $\rho,p$ — density and pressure of matter and radiation only; $\Lambda/3$ — the repulsive vacuum contribution. Reading: with matter negligible, $\ddot a/a=\Lambda/3>0$ — an empty universe with $\Lambda>0$ accelerates. The first Friedmann equation is the companion energy constraint, with $\Lambda/3$ a constant floor under the expansion rate that neither matter nor curvature can erode.

H^2=\left(\frac{\dot a}{a}\right)^2=\frac{8\pi G}{3}\rho-\frac{k}{a^2}+\frac{\Lambda}{3} \qquad (4)

where: $H$ — Hubble parameter; $k=+1,0,-1$ — spatial curvature constant. Reading: as $\rho$ and $k/a^2$ redshift away, $H\to\sqrt{\Lambda/3}$ — the de Sitter attractor. Local conservation gives the continuity equation, whose solution for constant $w$ is the dilution law that separates $\Lambda$ from everything else.

\dot\rho+3H(\rho+p)=0\;\Longrightarrow\;\rho\propto a^{-3(1+w)} \qquad (5)

where: $w=p/\rho$ — equation-of-state parameter. Reading: matter ( $w=0$ ) falls as $a^{-3}$ , radiation ( $w=\tfrac13$ ) as $a^{-4}$ , and vacuum energy ( $w=-1$ ) as $a^{0}$ — constant. Each component is packaged as a fraction of the critical density; in a flat universe they close to unity.

\Omega_\Lambda=\frac{\rho_\Lambda}{\rho_{\rm crit}}=\frac{\Lambda}{3H_0^2},\qquad \Omega_m+\Omega_r+\Omega_\Lambda+\Omega_k=1 \qquad (6)

where: $\rho_{\rm crit}=3H_0^2/(8\pi G)$ — critical density; $\Omega_\Lambda\approx0.685$ today; $\Omega_k=-k/(a_0^2H_0^2)$ . Reading: dark energy supplies about two-thirds of the present energy budget. When $\Lambda$ finally dominates a flat universe, equation (4) integrates to exponential growth — the de Sitter solution that is the late-time fate of $\Lambda$ CDM.

a(t)\propto e^{H_\Lambda t},\qquad H_\Lambda=\sqrt{\frac{\Lambda}{3}}=\sqrt{\frac{8\pi G\rho_\Lambda}{3}} \qquad (7)

where: $H_\Lambda$ — the asymptotic constant Hubble rate set by $\Lambda$ . Reading: the expansion rate levels off, and a cosmological event horizon forms at comoving distance $c/H_\Lambda$ . Because a true constant is only the simplest guess, observers fit dark energy with a two-parameter equation of state allowing time variation, the Chevallier–Polarski–Linder form.

w(a)=w_0+w_a(1-a) \qquad (8)

where: $w_0$ — present equation of state; $w_a$ — its rate of change. Reading: a genuine cosmological constant demands $w_0=-1$ , $w_a=0$ exactly; any robust departure signals dynamical dark energy or new gravity.

Derivation AWhy vacuum energy never dilutes and therefore always wins

The goal is to derive, from local energy-momentum conservation alone, the dilution law $\rho\propto a^{-3(1+w)}$ that governs every cosmic fluid, and to read off its most consequential special case: a component with $w=-1$ keeps a fixed energy density while everything else thins, so its eventual dominance is not a coincidence but a mathematical certainty forced by the continuity equation and a constant equation of state.

Step 1. In an FLRW universe the $\nu=0$ component of $\nabla^\mu T_{\mu\nu}=0$ reduces to the fluid continuity equation $\dot\rho+3H(\rho+p)=0$ , with $H=\dot a/a$ . Why: the $3Hp$ term is the work the fluid does against expansion — exactly what distinguishes the components.

Step 2. For constant $p=w\rho$ , substitute to get $\dot\rho/\rho=-3(1+w)\dot a/a$ , then integrate: $\ln\rho=-3(1+w)\ln a+\text{const}$ , so $\rho\propto a^{-3(1+w)}$ . Why: the exponent $-3(1+w)$ sets how strongly a fluid feels expansion, fixed entirely by $w$ .

Step 3. Insert the values: $w=0$ gives $\rho_m\propto a^{-3}$ , $w=\tfrac13$ gives $\rho_r\propto a^{-4}$ , and $w=-1$ gives $\rho_\Lambda\propto a^{0}$ — a constant. Why: the vacuum's negative pressure does negative work as space grows, cancelling volume dilution, so its density holds fixed.

Step 4. Form the ratio $\rho_\Lambda/\rho_m\propto a^{3}$ : it grows without bound, so however small $\Omega_\Lambda$ was early on, $\Lambda$ must overtake matter and dominate the far future. Why: it makes today's near-equality of $\Omega_\Lambda$ and $\Omega_m$ an inevitable, once-only crossover. *These results follow directly from the continuity equation: $\rho\propto a^{-3(1+w)}$ ; setting $w=-1$ gives $\rho_\Lambda=\text{const}$ ; and the ratio $\rho_\Lambda/\rho_m\propto a^3\to\infty$ .*

Go deeper · Derivation B · 1 minMatter–dark-energy equality and the onset of acceleration

Derivation BMatter–dark-energy equality and the onset of acceleration

The aim is to pin down two distinct epochs that are easy to conflate: the redshift $z_{\rm eq}$ where the constant vacuum density first equals the diluting matter density, and the earlier redshift $z_{\rm acc}$ where the expansion actually starts to accelerate. They differ because acceleration is governed by $\rho+3p$ , not by which component is larger — and separating them cleanly dissolves the "why does acceleration start before $\Lambda$ dominates?" puzzle. Both fall out of the dilution laws and the present density parameters.

Step 1. Write $\rho_m(z)=\rho_{m,0}(1+z)^3$ and $\rho_\Lambda(z)=\rho_{\Lambda,0}$ using $1+z=a_0/a$ ; setting them equal gives $\rho_{m,0}(1+z_{\rm eq})^3=\rho_{\Lambda,0}$ , hence $(1+z_{\rm eq})^3=\Omega_\Lambda/\Omega_m$ . Why: dividing by the common critical density turns densities into the density parameters observers actually measure.

Step 2. With $\Omega_\Lambda=0.685$ , $\Omega_m=0.315$ , evaluate $(0.685/0.315)^{1/3}=1.296$ , so $z_{\rm eq}\approx0.30$ . Why: this is the budget crossover, but the universe is already accelerating by then.

Step 3. Acceleration begins where $\ddot a=0$ , i.e. $\rho_{\rm tot}+3p_{\rm tot}=0$ . Matter contributes $\rho_m$ ( $p_m=0$ ) and $\Lambda$ contributes $-2\rho_\Lambda$ , so the condition is $\rho_m=2\rho_\Lambda$ , giving $(1+z_{\rm acc})^3=2\Omega_\Lambda/\Omega_m$ . Why: the factor of two is the point — repulsion need only beat matter's attraction, not exceed its density.

Step 4. Evaluate $(2\times0.685/0.315)^{1/3}=(4.349)^{1/3}=1.632$ , so $z_{\rm acc}\approx0.63$ , larger than $z_{\rm eq}\approx0.30$ . Why: acceleration switched on ~6 billion years ago, before $\Lambda$ caught up with matter — genuinely different events. *These values follow from the Planck 2018 $\Lambda$ CDM parameters: $(1+z_{\rm eq})^3=\Omega_\Lambda/\Omega_m=2.175\Rightarrow z_{\rm eq}=0.30$ ; $(1+z_{\rm acc})^3=2\Omega_\Lambda/\Omega_m=4.35\Rightarrow z_{\rm acc}=0.63$ .*

Go deeper · Derivation C · 1 minConstant density gives de Sitter expansion and a finite event horizon

Derivation CConstant density gives de Sitter expansion and a finite event horizon

This derivation solves the flat Friedmann equation for a universe left with only $\Lambda$ and shows the outcome is not merely eternal expansion but a change in causal structure: the scale factor grows exponentially, the Hubble rate freezes, and the comoving distance light can ever traverse into the future converges, walling each observer inside a cosmic event horizon. It turns " $\Lambda$ wins" into a concrete picture of the end state.

Step 1. Take $k=0$ and let matter and radiation dilute to nothing, so equation (4) leaves $H^2=\Lambda/3$ , hence $\dot a/a=\sqrt{\Lambda/3}\equiv H_\Lambda$ , a constant. Why: with only the vacuum floor left, constant $H$ is the defining feature of de Sitter space.

Step 2. Integrate the separable equation $\mathrm{d}a/a=H_\Lambda\,\mathrm{d}t$ to get $a(t)=a_0\,e^{H_\Lambda(t-t_0)}$ . Why: every comoving separation grows by a factor $e$ in a fixed time $1/H_\Lambda$ , forever — expansion that never slows.

Step 3. The future event horizon is $d_{\rm eh}=a(t)\int_t^\infty \mathrm{d}t'/a(t')=c/H_\Lambda$ , a finite proper distance, because $\int e^{-H_\Lambda t'}\mathrm{d}t'$ converges. Why: light emitted beyond it is carried away faster than it can approach, so it never arrives — a true horizon, unlike a matter universe's ever-growing particle horizon.

Step 4. Galaxies not bound to us cross this horizon one by one, their light stretched to unobservable redshift, until the accessible universe empties to the Local Group alone. Why: a positive $\Lambda$ eventually hides most of the universe from view. *These results follow from the flat Friedmann equation: $H^2=\Lambda/3\Rightarrow a\propto e^{H_\Lambda t}$ , the de Sitter metric; and the horizon integral converges to the finite value $c/H_\Lambda$ .*

Limiting cases

How $\Lambda$ and its dark-energy generalizations behave across distinct regimes:

Case	Result	Meaning
Pure cosmological constant	$w=-1,\ \rho_\Lambda=\text{const},\ p_\Lambda=-\rho_\Lambda$	energy density does not dilute; the canonical case identified with vacuum energy
Acceleration threshold	$\ddot a>0\iff w<-\tfrac13$	any component with sufficiently negative pressure accelerates expansion; $w=-\tfrac13$ is the dividing line
Quintessence (dynamical)	$-1<w(t)<-\tfrac13$	a slowly rolling scalar field with time-varying $w$ ; dilutes slowly rather than staying perfectly constant
Phantom energy	$w<-1$	density grows with expansion, driving a "Big Rip" that tears apart bound structure in finite time
Late-time de Sitter limit	$a\propto e^{H_\Lambda t},\ H_\Lambda=\sqrt{\Lambda/3}$	with $\Lambda>0$ dominating, the universe approaches exponential expansion at constant Hubble rate

Common trapDark energy is a repulsive force that will eventually pull apart atoms, planets, and galaxies

For a pure cosmological constant, no. Two traps hide here. First, $\Lambda$ is not a force acting between objects; it alters the expansion of unbound, comoving separations. Gravitationally bound systems — atoms, the Solar System, galaxies, the Local Group — long ago decoupled from the Hubble flow and do not expand, and bound gravity overwhelms $\rho_\Lambda$ 's negligible tidal tendency by dozens of orders of magnitude. Only phantom dark energy with $w<-1$ produces a genuine "Big Rip" that shreds bound structures, and current data give $w\approx-1$ . Second, do not read "positive vacuum energy" as attractive: the repulsion comes from the pressure, $\rho+3p=-2\rho_\Lambda<0$ , which is why $\Lambda>0$ violates the strong energy condition. And keep $\Lambda$ (length $^{-2}$ ) distinct from $\rho_\Lambda=\Lambda/(8\pi G)$ (energy per volume); they differ by $8\pi G$ .

Worked examples

1 · Two redshifts: when matter yields and when acceleration begins (fully worked)

Using the Planck values $\Omega_\Lambda=0.685$ and $\Omega_m=0.315$ , find the redshift of matter–dark-energy equality and the redshift at which cosmic acceleration switched on, and explain why they differ.

Step 1. Equality is where diluting matter meets the constant vacuum density: $(1+z_{\rm eq})^3=\Omega_\Lambda/\Omega_m=0.685/0.315=2.175$ . The cube root gives $1+z_{\rm eq}=1.296$ , so $\mathbf{z_{eq}\approx0.30}$ .

Step 2. Acceleration begins where $\rho_{\rm tot}+3p_{\rm tot}=0$ . Matter contributes $\rho_m$ and $\Lambda$ contributes $-2\rho_\Lambda$ , so $\rho_m=2\rho_\Lambda$ : $(1+z_{\rm acc})^3=2\Omega_\Lambda/\Omega_m=4.349$ . The cube root gives $\mathbf{z_{acc}\approx0.63}$ .

Step 3. The two differ because acceleration is decided by $\rho+3p$ : repulsion need only beat matter's attraction, which happens when $\rho_m$ falls to twice $\rho_\Lambda$ — earlier than simple density equality. The universe began accelerating around 6 billion years ago, well before $\Lambda$ took the lead in the budget. Acceleration ( $z\approx0.63$ ) precedes dark-energy domination ( $z\approx0.30$ ) — not the same milestone.

2 · The de Sitter future and the horizon around every observer (fully worked)

With $H_0=67.4\ \mathrm{km\,s^{-1}\,Mpc^{-1}}$ and $\Omega_\Lambda=0.685$ , find the asymptotic Hubble rate, the e-folding time, and the radius of the future event horizon.

Step 1. As matter and radiation dilute away, equation (4) leaves $H\to H_\infty=\sqrt{\Lambda/3}=H_0\sqrt{\Omega_\Lambda}=67.4\times\sqrt{0.685}=\mathbf{55.8\ km\,s^{-1}\,Mpc^{-1}}$ .

Step 2. In SI, $H_\infty=55.8/(3.086\times10^{19})=1.81\times10^{-18}\ \mathrm{s^{-1}}$ , so the e-folding time is $1/H_\infty=5.53\times10^{17}\ \mathrm{s}\approx\mathbf{17.5\ Gyr}$ .

Step 3. The future event horizon is $d_{\rm eh}=c/H_\infty=(2.998\times10^8)/(1.81\times10^{-18})\approx\mathbf{17.5\ Gly}$ .

Step 4. A $\Lambda>0$ universe ends cold, dark, and exponentially expanding, every observer sealed inside a de Sitter horizon roughly the size of today's observable universe as galaxies beyond it redshift into invisibility. The far future is de Sitter — $H\to55.8$ , e-folding $17.5$ Gyr, horizon $17.5$ Gly.

3 · The cosmological constant problem in one ratio (fully worked)

Quantum field theory fills the vacuum with zero-point energy. Estimate its density with a Planck cutoff $E_{\rm Pl}=1.22\times10^{19}\ \mathrm{GeV}$ and compare with the observed $\rho_\Lambda\approx2.5\times10^{-47}\ \mathrm{GeV^4}$ .

Step 1. A vacuum energy density has dimensions (energy) $^4$ and the only scale is the cutoff, so $\rho_{\rm vac}^{\rm QFT}\sim E_{\rm Pl}^4$ .

Step 2. Evaluate: $E_{\rm Pl}^4=(1.22\times10^{19})^4\approx\mathbf{2.2\times10^{76}\ GeV^4}$ .

Step 3. Take the ratio: $2.2\times10^{76}/2.5\times10^{-47}\approx9\times10^{122}$ — theory overshoots observation by about 120 orders of magnitude, the largest such mismatch in physics.

Step 4. The observed density corresponds to an energy scale $\rho_\Lambda^{1/4}\approx2.2\times10^{-12}\ \mathrm{GeV}\approx\mathbf{2\ meV}$ , a whisper beside the Planck scale. Either some unknown mechanism cancels the vacuum energy to 120 decimal places and leaves exactly this residue, or our reasoning is incomplete. No accepted resolution exists — this is the cosmological constant problem.

Physics of the portrait

Dark energy is one of the few pieces of fundamental physics whose discovery can be dated to a single year and pinned on two rival teams racing the same supernovae — best told through the observer who spent a decade building the technique.

Origins · 1 minSaul Perlmutter and how this was discovered

Saul Perlmutter

born 1959 · observational cosmology and the discovery of cosmic acceleration

Saul Perlmutter built the case for dark energy from the instrument up. Through the late 1980s and 1990s he led the Supernova Cosmology Project at Berkeley, wrestling Type Ia supernovae — the standardizable candles whose peak brightness, once corrected for light-curve shape, marks a known luminosity — into a tool precise enough to weigh the universe. The plan was to measure cosmic deceleration by comparing distant supernovae's faintness to their redshift. By 1998 both his team and the rival High-z Supernova Search Team, led by Brian Schmidt with Adam Riess as lead analyst, reached the same startling result from independent data — the supernovae were too faint, meaning the expansion was speeding up. A positive cosmological constant, the term Einstein introduced in 1917 and abandoned, fit at $\Omega_\Lambda\approx0.7$ , and Michael Turner soon named the agent "dark energy." The 2011 Nobel Prize went jointly to Perlmutter, Schmidt, and Riess. What makes the episode exemplary is its discipline: two competing groups, each braced to catch the other's error, converged on a conclusion neither wanted — that most of the universe is a substance no one had confirmed existed, doing the one thing gravity was not supposed to do.

History

1917

— Einstein introduces Λ to force a static universe; de Sitter finds the empty exponentially expanding solution

1929

— Hubble establishes the distance–velocity relation, evidence for cosmic expansion

1989

— Weinberg's review sharpens the cosmological constant problem to ~120 orders of magnitude

1998

— the Supernova Cosmology Project and the High-z team find the expansion accelerating

2000

— CMB balloon experiments confirm spatial flatness, closing the budget with dark energy

2011

— Nobel Prize to Perlmutter, Schmidt, and Riess for accelerating expansion

Going further

Texts. Misner, Thorne & Wheeler, Gravitation, §27.11 · Wald, General Relativity, §5.2 · Carroll, Spacetime and Geometry, Ch. 8 and §4.5 · Hartle, Gravity, Ch. 18–19 · Schutz, A First Course in General Relativity, Ch. 12 · Weinberg, "The Cosmological Constant Problem," Rev. Mod. Phys. 61, 1 (1989) · Peebles & Ratra, "The cosmological constant and dark energy," Rev. Mod. Phys. 75, 559 (2003) · Riess et al., AJ 116, 1009 (1998) and Perlmutter et al., ApJ 517, 565 (1999); Planck 2018 Results VI, A&A 641, A6 (2020). All key numbers follow from $H_0=67.4\ \mathrm{km\,s^{-1}\,Mpc^{-1}}$ , $\Omega_\Lambda=0.685$ , $\Omega_m=0.315$ (Planck 2018): $z_{\rm eq}=(\Omega_\Lambda/\Omega_m)^{1/3}-1\approx0.30$ ; $z_{\rm acc}=(2\Omega_\Lambda/\Omega_m)^{1/3}-1\approx0.63$ ; $\Lambda\approx1.1\times10^{-52}\ \mathrm{m^{-2}}$ , $\rho_\Lambda\approx5.8\times10^{-27}\ \mathrm{kg\,m^{-3}}\approx2.5\times10^{-47}\ \mathrm{GeV^4}\approx(2.2\ \mathrm{meV})^4$ ; $H_\infty=H_0\sqrt{\Omega_\Lambda}\approx55.8\ \mathrm{km\,s^{-1}\,Mpc^{-1}}$ , e-folding and horizon $\approx17.5\ \mathrm{Gyr/Gly}$ ; QFT $E_{\rm Pl}^4\approx2.2\times10^{76}\ \mathrm{GeV^4}$ , a $\sim10^{123}$ discrepancy (the ~120-order figure). The 0.25-magnitude supernova offset at $z\approx0.5$ from Riess (1998) and Perlmutter (1999).

Builds on: The Friedmann Equations · The Cosmological Equation of State · Critical Density and the Density Parameters · The FLRW Metric. Leads to: The Dark-Energy-Dominated Era · Cosmological Horizons · The Scale Factor and Hubble Parameter.

Ask the tutor: Ask me to walk from the continuity equation to the accelerating sky — why $w=-1$ makes vacuum energy immortal, why $\rho+3p$ turns it repulsive, and why acceleration began before dark energy took the lead.

Is dark energy the same thing as the cosmological constant?

Not quite — the cosmological constant is the simplest candidate for dark energy, not a synonym. "Dark energy" is the observational name for whatever smooth component drives cosmic acceleration ( $\ddot a>0$ ). A cosmological constant is the specific hypothesis that this component is exactly Lorentz-invariant vacuum energy with $w=-1$ and a density that never changes. Other candidates — collectively "quintessence" — are dynamical fields with $w$ near but not equal to $-1$ . Every measurement so far is consistent with a plain $\Lambda$ , but proving dark energy is a true constant rather than a slowly evolving field is the goal of DESI, Euclid, and Roman.

If space is expanding faster and faster, will it eventually pull atoms and galaxies apart?

For a genuine cosmological constant, no. Bound systems — atoms, planets, stars, galaxies, even the Local Group — long ago decoupled from the cosmic expansion; their internal gravity or electromagnetism holds them at fixed size, and a constant vacuum energy adds only an absurdly tiny outward tendency these forces overwhelm by tens of orders of magnitude. Only phantom dark energy with $w<-1$ , whose density grows without limit, produces a "Big Rip" that tears bound structures apart, and current data show no evidence for it. What accelerates is the expansion of unbound, comoving distances between galaxy clusters not gravitationally tied together.

Why did acceleration begin at z ≈ 0.63 but dark energy only overtook matter at z ≈ 0.30?

Because acceleration is decided by $\rho+3p$ , not by which component is denser. The vacuum contributes $-2\rho_\Lambda$ to the source and matter contributes $+\rho_m$ , so the total flips negative — acceleration turns on — when $\rho_m$ falls to twice $\rho_\Lambda$ , at $(1+z)^3=2\Omega_\Lambda/\Omega_m$ , giving $z\approx0.63$ . Density equality, $\rho_m=\rho_\Lambda$ , comes later at $(1+z)^3=\Omega_\Lambda/\Omega_m$ , or $z\approx0.30$ . So the universe accelerated for billions of years before dark energy became the dominant slice of the budget.

What is the "coincidence problem" or "why now?"

It is the puzzle of timing. Matter density falls as $a^{-3}$ while $\rho_\Lambda$ stays fixed, so the two are equal at only one moment in cosmic history — yet that moment is essentially now, at $z\sim0.3$ , out of a span from the Big Bang to the infinite de Sitter future. For most of the past matter dwarfed $\Lambda$ ; for all of the future $\Lambda$ will dwarf matter; we happen to observe during the brief crossover. Whether this is a genuine clue (perhaps dark energy tracks matter dynamically) or merely a selection effect tied to when observers form is unresolved, and it motivates taking dynamical dark energy seriously.

Could there be no dark energy at all — just a mistake in our gravity?

It is a live possibility, which is why surveys test it directly. Acceleration is inferred by applying general relativity to the observed expansion; if instead gravity is modified on cosmological scales — $f(R)$ gravity, DGP braneworlds, and the like — one might mimic acceleration without any new energy component. The way to tell them apart is that dark energy and modified gravity generally predict different growth rates for cosmic structure at the same expansion history, so measuring both the expansion (supernovae, baryon acoustic oscillations) and the clustering (weak lensing) can distinguish them. So far $\Lambda$ CDM fits both, but the test is a central goal of Euclid and LSST.

How is the equation of state w actually measured?

Through the expansion history, since $w$ controls how dark energy's density — and therefore $H(z)$ — evolves. Type Ia supernovae give luminosity distances $d_L(z)$ ; baryon acoustic oscillations provide a standard ruler pinning $H(z)$ directly; the CMB fixes the high-redshift boundary condition and sound horizon; weak lensing adds the growth of structure. Each depends on $\int \mathrm{d}z/H(z)$ with $H(z)$ carrying the dark-energy term, so combining them constrains $w$ and its evolution. Analysts fit $w(a)=w_0+w_a(1-a)$ ; a true cosmological constant sits at $w_0=-1$ , $w_a=0$ , and the enterprise is to see whether the data insist on that point or drift from it.