Configuration Interaction
A single Slater determinant, however carefully optimized, cannot describe what two electrons do when they nearly collide. It gets the average repulsion right but not the instantaneous dodge-and-weave. This is the electron correlation that lowers the true energy below the Hartree–Fock value. Configuration interaction (CI) is the most conceptually direct fix. It builds a bigger, smarter trial wavefunction by mixing the Hartree–Fock determinant with determinants describing electrons promoted into virtual orbitals. A variational calculation then decides how much of each to include. The idea sounds almost too simple to be a real quantum chemistry method — just diagonalize a bigger matrix. That simplicity is exactly why CI is the natural first stop after Hartree–Fock. It converts the many-body correlation problem into ordinary linear algebra. Build the Hamiltonian matrix in a basis of determinants, find its lowest eigenvalue, and read off the eigenvector as the mixing coefficients. Full CI, done in a complete basis, is exact nonrelativistic quantum chemistry. It is the reference against which every cheaper correlation method is judged. But full CI is also a combinatorial catastrophe. The number of determinants grows factorially with the number of electrons and orbitals. So real calculations must truncate the excitation level — singles only (CIS), singles and doubles (CISD), and so on. This truncation buys tractability at a brutal cost: truncated CI is not size-consistent. The energy of two infinitely separated helium atoms computed by CISD is not twice the energy of one helium atom computed by CISD. That failure, first exposed starkly in the 1970s, reshaped the entire field. It motivated the search for methods — coupled cluster and perturbation theory — that get correlation energy without breaking additivity. This article builds CI from the ground up. It covers how the excited determinants arise, and why Brillouin's theorem kills CIS as an energy method. It explains how the secular equations are solved, and exactly how and why size-consistency fails. A fully worked numerical demonstration follows, using a two-electron toy system where the arithmetic can be checked by hand.
- CI expands the wavefunction as a linear combination of the HF determinant plus singly, doubly, …, N-tuply excited determinants, with coefficients found variationally.
- Brillouin's theorem shows singly-excited determinants do not couple to the HF reference through , so CIS gives zero correlation energy correction to the ground state (but describes excited states).
- CISD (singles + doubles) recovers most dynamic correlation for small systems but misses higher excitations that matter for larger systems.
- Full CI in a given one-electron basis is the exact solution of the electronic Schrödinger equation within that basis — the ultimate benchmark.
- Truncated CI (CID, CISD, …) is not size-consistent: for noninteracting fragments, because disconnected quadruple excitations are missing.
- Key idea: CI turns "find the correlated wavefunction" into "diagonalize a Hamiltonian matrix in a basis of Slater determinants," and the truncation needed to make that matrix small is precisely what breaks additivity of the energy.
Where this lives today
Full CI, though exponentially expensive, is still the gold-standard benchmark used to calibrate every approximate correlation method — quantum chemists routinely run full CI on tiny model systems (a handful of electrons in a modest basis) purely to certify that a new cheaper method (a new density functional, a new coupled-cluster truncation, a new machine-learned potential) gets the right answer where the exact one is computable. CISD and its multireference cousin MRCI (multireference CI, often with a Davidson size-consistency correction added ad hoc) remain the workhorses for excited-state spectroscopy and photochemistry — computing UV-Vis absorption spectra of organic dyes, conical intersections in photoisomerization (the mechanism behind vision, via retinal photochemistry), and transition-metal d–d and charge-transfer transitions where multiple electronic configurations are intrinsically close in energy. Selected/adaptive CI algorithms (CIPSI, Heat-bath CI, semistochastic FCI-QMC) are a modern renaissance of the CI idea: rather than truncating by excitation level, they truncate by importance, keeping only the determinants that actually matter energetically, and have pushed near-exact CI-quality benchmarks to systems with dozens of correlated electrons — directly informing where cheaper production methods like density functional theory and coupled cluster theory (see Moller-Plesset Perturbation Theory (MP2) and Coupled Cluster Theory for the size-consistent alternatives this article's failure motivates) can be trusted or must be corrected.
Ask the tutor: Why does representing the wavefunction as an exponential of excitation operators (as in coupled cluster theory) automatically restore size-consistency where a truncated linear CI expansion cannot?
The physical picture
Start from the Hartree–Fock ground state , a single Slater determinant built from the lowest spin orbitals out of a full one-electron basis of spin orbitals (so there are empty, "virtual" orbitals). Hartree–Fock is the best single determinant, found by the variational optimization discussed in Electron Correlation and the Correlation Energy and built on the antisymmetry requirement of Antisymmetry and the Slater Determinant. But the true ground state is not a single determinant. Configuration interaction restores flexibility by writing
where denotes the determinant obtained from by replacing occupied spin orbital with virtual spin orbital (a "single excitation"), replaces two occupied orbitals with two virtuals ("double excitation"), and so on up to -fold excitations. Each determinant is itself a full antisymmetrized product of spin orbitals — nothing but book-keeping on top of Slater's construction — but the combination is no longer a single product: it is a genuine many-body superposition. Physically, the double excitations are the workhorses. They describe the instantaneous correlation of electron pairs — when electron 1 is close to electron 2 in the HF description, exciting both into virtuals with the right phase lets the wavefunction build in a "hole" around each electron, the Coulomb correlation hole. Singles, by contrast, mostly relax orbitals (they mix in a little orbital rotation) and contribute almost nothing to the ground-state correlation energy directly, for a reason made precise by Brillouin's theorem below. Triples and quadruples matter increasingly as the system gets bigger, because they can be built approximately as products of independent double excitations on separate parts of the molecule — and it is exactly this product structure that truncated CI cannot represent, since CISD stops at pairs and cannot see the simultaneous double-double excitation on two well-separated fragments.
The variational principle guarantees that adding more determinants can only lower (or leave unchanged) the ground-state energy, since CI is nothing but a linear variational calculation in an expanded basis of many-electron functions. The lowest eigenvalue of the CI Hamiltonian matrix is therefore always an upper bound to the true ground-state energy, and it approaches the exact answer (within the one-electron basis) as more excitation classes are included — reaching it exactly at full CI.
The core ideas
The CI expansion and secular equations. Writing the trial wavefunction as a linear combination of all -electron Slater determinants built from a fixed one-electron basis,
where: labels the HF reference and labels singly, doubly, … excited determinants, and are variational coefficients — minimizing the Rayleigh quotient subject to normalization gives the matrix eigenvalue problem
where: is the CI (secular) matrix, its eigenvalues (ground and excited electronic states simultaneously), the eigenvector of expansion coefficients. This is the exact many-body analogue of the linear variation method used for simple trial functions — only now the "basis functions" are entire Slater determinants. Reading: diagonalizing once yields the entire spectrum: the lowest eigenvalue is the correlated ground state, and higher eigenvalues are approximate excited states — CI is simultaneously a ground-state and excited-state method, unlike Hartree–Fock.
Slater–Condon rules. The matrix elements are never computed by brute-force integration over -electron coordinates; they follow from compact rules depending on how many spin orbitals differ between and :
where: is the Fock operator whose eigenfunctions are the HF orbitals, its off-diagonal occupied–virtual element (zero at self-consistency), and is an antisymmetrized two-electron integral in physicists' notation. Reading: Brillouin's theorem is the reason CIS (which only adds single excitations to ) gives a ground-state energy that is identical to Hartree–Fock through first order — singles do not couple to directly. The Hamiltonian is a two-body operator, so couples directly only to doubles; triples and higher couple to only indirectly, through their coupling to doubles and singles inside the CI matrix. This is what makes doubles the dominant correlating configurations and is the microscopic reason CISD is the traditional workhorse truncation.
Size-consistency (formal statement). For two well-separated, noninteracting subsystems and , exactness requires
where: denotes the supersystem at a separation large enough that all inter-fragment interactions vanish. Full CI satisfies this identically; any truncated CI (CID, CISD, CISDT, …) generally does not, because a simultaneous double excitation on and a double excitation on is a quadruple excitation relative to the supersystem reference, and CISD excludes quadruples.
Derivations
Goal. Show that when is built from canonical Hartree–Fock orbitals, and understand the consequence for CIS.
Step 1 — Write the electronic Hamiltonian in second-quantized/matrix-element form. For electrons in spin orbitals,
where is the one-electron core Hamiltonian (kinetic energy plus nuclear attraction) for electron . Using the Slater–Condon rule for determinants differing by exactly one spin orbital (),
Step 2 — Recognize the Fock matrix element. The Fock operator acting on spin orbital is defined, for an -electron closed-shell or spin-orbital HF reference, as
so that
Comparing with Step 1, the right-hand side is exactly :
Step 3 — Use the defining property of canonical HF orbitals. Canonical Hartree–Fock orbitals are chosen (by a unitary rotation among occupied orbitals and separately among virtuals) to diagonalize the Fock matrix within each block, and the self-consistent-field condition additionally forces the occupied–virtual block to vanish:
This is a direct consequence of the HF variational condition applied specifically to occupied–virtual rotations.
Step 4 — Conclude. Therefore
for every single excitation, when the orbitals used are the converged canonical HF set. Consequently, in the CI secular matrix, the entire first row/column connecting to all singles is exactly zero. By first-order perturbation theory this means singles contribute zero first-order correction to the HF ground-state energy and, by Löwdin partitioning, their leading effect on enters only at second order through mixing mediated by doubles. This is why a CI truncated at singles only (CIS) reproduces for the ground state and is used almost exclusively for excited states, where the singles do mix with each other and with doubles.
Go deeper · Derivation B · 2 minSize-inconsistency of truncated CI: the two-noninteracting-helium argument
Goal. Prove explicitly that CID (doubles-only CI, the cleanest case) applied to a supersystem of two infinitely separated, identical two-electron atoms does not give twice the monomer CID energy — and identify exactly which configurations are missing.
Step 1 — Set up the monomer problem. Let atom be a two-electron system (e.g., a minimal-basis He atom) with HF ground state built from occupied orbital and some virtual orbitals. In a minimal basis with one occupied and one virtual spin-orbital pair (a 2-orbital model, "full CI on He" toy), the monomer CID wavefunction is
where is the double excitation of both electrons of atom from the occupied pair into the virtual pair. Solving the CID secular equation for the monomer gives ground-state energy for some correlation lowering , exact in this minimal model because with only one occupied spatial orbital, CID is full CI for the monomer.
Step 2 — Build the supersystem reference at infinite separation. Put atom , an identical copy, infinitely far from so there is no interaction: . The exact ground state factorizes,
and the exact total energy is additive: . Expand each factor as reference plus double excitation, and similarly for . Multiplying out,
Step 3 — Classify each term by excitation level relative to the supersystem HF reference . The first term is the reference itself. The second and third terms are double excitations (two electrons on promoted, untouched, or vice versa) — CID keeps these. The fourth term, , has four spin orbitals changed relative to the supersystem reference (two on , two on simultaneously): it is a quadruple excitation. Crucially, it is a disconnected quadruple — simply the product of two independent doubles on non-interacting fragments — and its coefficient factorizes exactly as , the product of the monomer amplitudes. There is nothing exotic about it; it is required by simple algebra (multiplying out a product of two sums).
Step 4 — Show CID (or CISD) supersystem excludes exactly this term. CID for the supersystem is defined as plus all double excitations relative to that reference — but by definition it stops at doubles, so the quadruple term is not included in the CID variational space at all. Solving the supersystem CID secular equations with only reference + doubles necessarily gives an energy
and in fact (see the worked example below) gives an energy higher than the additive sum — the variational calculation is starved of a term the exact wavefunction needs, and by the variational principle any energy computed with a wavefunction missing a needed component cannot be lower than one computed with it present. Since the missing disconnected quadruple is exactly the product term forced by simple factorization, the size-consistency error grows with the number of noninteracting units — it is not a small correction, it is a qualitative failure that gets worse as the "molecule" (or cluster of identical fragments) gets larger. This single derivation is why truncated CI was abandoned as a general-purpose method for large systems in favor of size-consistent alternatives such as coupled-cluster theory.
Worked examples
Example 1 — Foundational: building and diagonalizing a minimal CI matrix by hand (two-electron, two-orbital model). Take a toy two-electron "atom" with one occupied spatial orbital (HF occupied, energy ) and one virtual spatial orbital (energy ), doubly occupied/empty in the closed-shell sense (spatial CI, singlet-adapted, so we need only the reference and the doubly-excited singlet ; the singly-excited configuration vanishes by symmetry/Brillouin's theorem for a closed shell). Use these representative numbers (not from any particular real atom, chosen asymmetric and dimensionless in hartree for clarity):
The CI matrix in the basis (singlet-coupled double excitation) is standard textbook algebra:
Take (Coulomb self-repulsion of ) and . Then
The secular determinant is
Expanding:
The quadratic formula gives
The lower root, hartree, is the (full) CI ground-state energy — lower than , the Hartree–Fock energy, by
the correlation energy recovered by mixing in the double excitation. Because this model has only one occupied and one virtual spatial orbital, this doubles-only CI is full CI for this system — an explicit, hand-checkable instance of the variational lowering promised by the theory. As a limiting-case check: if the coupling (no correlation term), the secular equation decouples and exactly, recovering the Hartree–Fock result with zero correlation energy, as it must.
Example 2 — Applied: CISD vs. CID vs. full CI energy ordering for a stretched bond (qualitative but numerically grounded). Consider H described in a minimal basis (this is the smallest system where singles, doubles, and the size-consistency question can all be illustrated together, and where full CI is exactly CISD — there are no triples or quadruples possible with only two electrons). In a minimal (STS-3G–like, two-orbital) basis, H has one bonding MO (occupied) and one antibonding MO (virtual); the only excitations available are the double excitation (the single excitation vanishes by symmetry, since changes overall spatial symmetry of a closed-shell singlet incorrectly — it is a triplet, not coupling to the singlet ground state). At the equilibrium bond length ( Å), representative minimal-basis numbers are
At a stretched bond ( Å, well past the point where the ionic HF description qualitatively fails), the double excitation coefficient becomes large (approaching relative to as , since the true wavefunction must become an equal mix of covalent and ionic-canceling configurations to dissociate correctly into two neutral H atoms). Representative stretched-bond numbers:
so the correlation energy grows to roughly — nearly fifteen times its equilibrium value — because Hartree–Fock's single-determinant description becomes qualitatively wrong at dissociation (it retains 50% ionic HH character that has no business surviving to infinite separation), while full CI corrects this exactly since the double excitation is precisely the configuration needed to cancel the spurious ionic term. This is why static correlation (large coefficient on one specific excited determinant, here the double) becomes dominant at stretched geometries, in contrast to the dynamic correlation (many small coefficients) that dominates near equilibrium — CI captures both, but a truncated CI or a perturbative method tuned for the equilibrium (dynamic-correlation) regime often fails badly in the stretched (static-correlation) regime. Because H has exactly two electrons, CISD = full CI here and there is no size-consistency error for the isolated molecule — the size-consistency problem appears only once we ask about two separated H molecules simultaneously, which is Example 3.
Example 3 — Competition-level: quantifying the size-consistency error for two identical noninteracting systems. Using the results of Example 1, suppose we now have two copies of that toy two-electron atom, infinitely far apart, each individually described exactly by the CI of Example 1 ( each). The exact (and, since each monomer's "CID" is already full CI, also the exact full-CI) energy of the noninteracting pair is additive:
Now perform CID (doubles only, relative to the supersystem reference ) directly on the 2-fragment supersystem, allowing only single-fragment double excitations and — not the simultaneous double-double (quadruple) term. By symmetry (identical fragments) the supersystem CID secular problem is a matrix in the basis :
(The off-diagonal zero between the two single-fragment doubles holds because and act on disjoint electrons — this block structure is itself only exactly this simple in the noninteracting limit.) By symmetry, one eigenvector is the antisymmetric combination with eigenvalue exactly (it does not mix with the reference, since the two off-diagonal 's cancel). The relevant symmetric block, in the basis , has off-diagonal element :
Solving:
So , compared with the exact additive value found above. The size-consistency error is
a genuine, nonzero, positive error (CID for the pair recovers less than twice the per-monomer correlation energy) purely because the disconnected quadruple excitation was excluded from the variational space — exactly the mechanism identified in the derivation above. As a limiting-case check, if the two monomers were allowed to interact (, the two-monomer basis would also need genuine four-electron double excitations spanning both fragments together, which are included at the CID/CISD level for a "real" bonded 4-electron molecule); it is specifically the noninteracting, well-separated limit that isolates the pure size-consistency artifact from ordinary intermolecular correlation, and the error shown here — small in this toy model but structurally the same mechanism — grows linearly with the number of identical noninteracting units in general, eventually dominating for large clusters or polymers.
Limiting cases, scope & common traps
| Regime / limit | What happens | Why |
|---|---|---|
| Full CI, any system | Exact nonrelativistic energy within the one-electron basis | All excitation levels present; no missing determinant, so no truncation error at all |
| CIS (singles only) | Ground-state energy = exactly | Brillouin's theorem: for canonical HF orbitals |
| CID / CISD | Recovers most dynamic correlation for small, compact molecules | Doubles couple directly to ; but disconnected quadruples on separated fragments are missing |
| Two or more noninteracting fragments | Missing disconnected higher excitations (Example 3) | |
| Bond stretching / dissociation | Static correlation dominates; HF and low-order truncated CI both degrade, but CI (with enough excitation levels) still improves qualitatively | Near-degenerate configurations (e.g. the doubly excited determinant) become comparably weighted to |
| (large molecule, extended system) | Truncated CI errors grow catastrophically; size-consistency failure compounds | More independent "fragments" each contribute missing disconnected excitations |
| Two-electron systems (e.g. H, He) | CISD = Full CI automatically | Only doubles (and, if symmetry allows, no singles) exist; no triples/quadruples possible with two electrons |
The chemist behind it
Origins · 1 minPer-Olov Löwdin and how this was discovered
Löwdin was one of the principal architects of postwar quantum chemistry as a mathematically rigorous discipline, formalizing natural orbitals, symmetric orthogonalization, and the partitioning technique used to analyze CI matrices and truncation errors. He founded the Sanibel Symposia and the Quantum Theory Project, institutions that turned configuration interaction and related many-body methods from isolated calculations into a systematic international research program. His insistence on precise variational bounds and natural-orbital analysis directly shaped how chemists came to understand — and eventually solve — the size-consistency problem of truncated CI.
Why does CI use Slater determinants rather than simple orbital products as the expansion basis?
Electrons are fermions, so the total wavefunction must be antisymmetric under exchange of any two electrons' coordinates — a requirement built directly into the Slater determinant construction. Using determinants as the building blocks of CI guarantees every term in the expansion, and hence the full CI wavefunction, automatically satisfies the Pauli antisymmetry requirement without any extra bookkeeping. A naive product expansion would need explicit antisymmetrization glued on afterward, and would double-count or omit exchange effects. Determinants are also the natural output of Hartree–Fock, so CI can be built directly on top of an existing, already-optimized HF calculation, reusing its orbitals and orbital energies with no extra machinery.
Why doesn't CIS improve the ground-state energy at all, if it clearly changes the wavefunction?
Brillouin's theorem shows that, using canonical Hartree–Fock orbitals, every singly-excited determinant has exactly zero Hamiltonian matrix element with the reference determinant. In a CI matrix restricted to , the reference row/column coupling to singles is entirely zero, so diagonalizing the block containing returns unchanged as the lowest eigenvalue coupled to that reference. Singles do mix strongly with each other and can produce meaningful excited-state energies (CIS is a standard cheap method for UV-Vis excitation energies), but for the ground state specifically, singles are a "dead end" without doubles present to mediate any indirect coupling.
Is full CI ever actually used for real molecules, or is it purely a theoretical benchmark?
Full CI's cost scales combinatorially — roughly as the binomial coefficient of orbitals choose electrons for each spin — so exact full CI is limited in practice to small molecules in modest basis sets (systems with perhaps 10–18 correlated electrons in a double-zeta basis, depending on available computer resources). Within that regime it is used as a genuine, not merely theoretical, benchmark: method developers routinely run full CI on molecules like water, methylene, or small hydrides to certify new density functionals, new coupled-cluster truncations, or new machine-learned interatomic potentials against the numerically exact nonrelativistic answer. Selected-CI and stochastic FCI-QMC methods have extended this exact benchmarking capability to considerably larger systems in recent years.
How is the size-consistency problem actually fixed in modern quantum chemistry?
Two main strategies are used. The first is to abandon the truncated-CI linear expansion in favor of an exponential parametrization of the wavefunction — coupled cluster theory — where the cluster operator automatically generates the necessary disconnected higher excitations as products of lower ones, restoring exact size-consistency (and, for the standard truncations like CCSD, full size-extensivity) essentially for free. The second is empirical correction of CISD itself, most commonly the Davidson correction, which estimates the missing quadruple-excitation contribution from the CISD singles/doubles coefficients and adds it back approximately. Coupled cluster has become the dominant modern solution precisely because it fixes the problem structurally rather than patching it after the fact.
Does size-consistency matter for a single, non-dissociating molecule, or only for comparing separated fragments?
It matters even for one molecule whenever you compare energies across different numbers of "independent" correlating units within that molecule — for example, computing a large hydrocarbon's total correlation energy, or comparing a dimer's binding energy against two monomers computed separately (a very common calculation in noncovalent-interaction and supramolecular chemistry). Any calculation that implicitly or explicitly compares energies at different particle numbers, or across different-sized fragments of an extended system, is exposed to the size-consistency error if a truncated CI method is used. For a single fixed molecule computed once, the absolute error is present but is usually absorbed into the general truncation error rather than showing up as a separate, obviously diagnosable artifact.
Why do doubles couple directly to the HF reference but triples do not?
The electronic Hamiltonian contains only one-electron and two-electron operators — it can, at most, simultaneously change the occupation of two spin orbitals in a single matrix element (via the two-electron repulsion term) or one spin orbital (via the one-electron term). A determinant differing from the reference in three spin orbitals (a triple excitation) therefore has an exactly zero direct Hamiltonian matrix element with , by the Slater–Condon rules, regardless of the orbital choice — this is a much more general and robust rule than Brillouin's theorem (which needed the extra assumption of canonical HF orbitals). Triples still matter energetically because they mix with doubles and singles inside the full CI matrix, providing an indirect but often significant contribution.
Is CI compatible with density functional theory, or are they alternative, mutually exclusive frameworks?
They are built on fundamentally different objects — CI is a wavefunction method expanding in explicit many-electron basis functions, while DFT works with the electron density and an (in principle exact, in practice approximate) exchange-correlation functional — so they are not directly combined in the same calculation. However, they are used together in practice: DFT orbitals are sometimes used as a starting point for building CI excitation spaces in multireference contexts, and full CI or high-level CISD/MRCI benchmarks are routinely used to validate and parametrize new density functionals against numerically exact reference data, especially for excited states and bond-breaking, where DFT's single-determinant-like starting point can struggle.