Optimizing Nonlinear Variational Parameters
Guess a shape for a wavefunction, leave one number free. Let calculus find the best value. This is the entire strategy of nonlinear variational optimization. It sounds almost too simple to explain why the helium atom yields to pencil-and-paper analysis. Helium is a genuine three-body Coulomb problem with no closed-form solution. Yet it can be solved to within a percent of the true ground-state energy. This happens when you let the orbital exponent in a hydrogen-like 1s function relax. It moves away from its "obvious" value. It settles wherever the energy functional is lowest. This matters because most interesting quantum systems have no exact solution. Multi-electron atoms, molecules, anything beyond the isolated hydrogen atom, all lack exact solutions to the Schrödinger equation. The The Variational Method with Trial Functions guarantees something useful. Any normalized trial function gives an energy expectation value at or above the true ground-state energy. But that theorem is only as good as the trial function you choose. The nonlinear twist is this: rather than fixing the functional form and computing one number, you build a parameter into the functional form itself. This might be an orbital exponent, a width, or a screening constant. Then you minimize the energy over that continuous parameter. The trial function reshapes itself in response to the physics. It contracts or expands until the energy stops falling. The big picture is simple. This single idea — differentiate , set , solve — is the ancestor of every self-consistent-field calculation used in modern computational chemistry. Slater-type orbitals with optimized exponents are one instance. Gaussian basis sets with optimized widths are another. Even the orbital contraction that occurs physically when nuclear charge increases follows the same logic. All are instances of the same variational logic. The famous result that helium's two 1s electrons behave as if the nuclear charge were screened is a good example. The charge drops from down to an effective . This is not an empirical fudge factor. It falls straight out of differentiating one integral. This article works through the mechanics of nonlinear parameter optimization in full. It restates the general variational theorem for a parameter-dependent trial function. It gives the complete algebra for the hydrogen atom with a floating exponent. This calculation must reproduce the exact answer, and does. It also covers the substantially harder but tractable helium calculation. This uses a screened hydrogenic product wavefunction. Along the way you will see exactly how the electron-electron repulsion integral is evaluated. You will see why the optimal exponent is less than the true nuclear charge. You will see how this single-parameter method sets the stage for the richer machinery of Linear Variation and Secular Equations.
- A nonlinear variational parameter (an orbital exponent, a width, a decay rate) is built into the functional form of a trial wavefunction before the energy is minimized.
- The recipe is always the same: build , differentiate with respect to , set the derivative to zero, solve for .
- Applied to the hydrogen atom with a trial exponent, the method exactly recovers and hartree — a crucial consistency check.
- Applied to helium with a screened hydrogenic product function, it gives and hartree, within about 2% of the experimental hartree.
- The optimal exponent is always less than the bare nuclear charge because each electron partially screens the nucleus from the other — the wavefunction relaxes outward to balance kinetic and potential energy contributions.
- This single-parameter optimization is the direct conceptual ancestor of self-consistent-field exponent optimization in modern quantum chemistry codes.
- Key idea: treat the trial wavefunction's shape parameter as a genuine variable, differentiate the energy expectation value with respect to it, and the stationary point is your best one-parameter approximation to the true ground state.
Where this lives today
The screened-exponent helium calculation is not a historical curiosity; it is the direct conceptual seed of modern quantum chemistry software. Every time a program like Gaussian, ORCA, or Psi4 runs a Hartree–Fock or density functional calculation, it is solving a vastly more elaborate version of exactly this problem: choosing a basis of functions with adjustable exponents, and letting the total electronic energy determine both the linear expansion coefficients (via the machinery that becomes Linear Variation and Secular Equations) and, in fully optimized basis sets, the nonlinear exponents themselves. In drug design, effective nuclear charges and orbital contraction directly govern electronegativity trends used to predict hydrogen-bond donor and acceptor strength in candidate molecules — the same screening logic explaining why helium's electrons see an effective charge of rather than explains why oxygen's lone pairs are more diffuse than fluorine's, shaping how a drug molecule's functional groups interact with a protein binding pocket. In materials science, the same idea underlies pseudopotential theory used in plane-wave density functional calculations of semiconductors and battery materials: chemically inert core electrons are replaced by an effective, parameter-optimized potential that reproduces the correct screening of valence electrons without explicitly treating every core orbital. In spectroscopy, Slater-type and Gaussian-type orbital exponents optimized this way feed directly into predicted absorption and emission energies used to assign unknown spectral lines in astrophysics and atmospheric chemistry — ionization energies and orbital sizes computed from optimized exponents underlie models of stellar atmospheres and planetary photochemistry. Even in undergraduate laboratory instruction, the helium exponent-optimization calculation remains one of the few calculations a student can perform entirely by hand while still touching a genuinely unsolved three-body problem, making it a perennial bridge between exactly solvable textbook physics and the approximate machinery that underlies essentially all of practical computational chemistry.
Ask the tutor: How would the helium calculation change if the two electrons were allowed to have independently optimized exponents instead of a single shared value?
The physical picture — thorough prose
Start from the variational theorem: for any normalized, well-behaved trial function satisfying the correct boundary conditions, the expectation value of the true Hamiltonian obeys
where is the true ground-state energy. This inequality holds for any choice of trial function — including one built from a family of functions labeled by a continuous parameter . If you write for such a family, then is itself a function of , and the theorem says every value of this function lies above . The best member of the family is whichever makes smallest — this is now an ordinary one-variable calculus minimization, not a functional variation over all possible wavefunctions. The physical intuition is that typically controls how tightly or loosely the electron density clings to the nucleus. A hydrogen-like 1s orbital has a decay constant : large means a compact, tightly bound-looking cloud; small means a diffuse cloud. The kinetic energy contribution to grows as (steep functions have more curvature, hence more kinetic energy by the uncertainty principle), while the potential energy contribution — attraction to the nucleus — grows more favorable (more negative) linearly in for a Coulomb potential. These two competing trends produce a single minimum: too small a wastes potential energy by keeping the electron too far from the nucleus, too large a wastes kinetic energy by over-localizing it. The compromise point is . For helium, the same balance operates but with an added twist: the two electrons repel each other. Using a product trial function of two hydrogen-like orbitals sharing one common exponent , that exponent no longer represents the bare nuclear charge — it represents an effective nuclear charge, reduced because each electron feels the true nucleus screened by the average presence of the other. The electron-electron repulsion integral, when included in , shifts the minimum from down to a smaller, screened value. This screening concept — later systematized into Slater's rules and into modern effective-core-potential methods — first appears here as a rigorous number from a two-line derivative, not as a rule of thumb.
The core ideas — governing equations
The general recipe for nonlinear parameter optimization rests on three equations.
where: is the trial function built with adjustable parameter ; is the exact Hamiltonian of the system; the denominator handles normalization explicitly in case is not pre-normalized for every . Reading: this is simply the variational energy functional, now viewed as an ordinary function of the single real number rather than as a functional over an infinite-dimensional space of functions.
where: the derivative is taken holding all other structural choices (functional form, basis) fixed; is the stationary point, and for well-behaved unimodal curves (as in these examples) it is the unique minimum. Reading: optimizing a nonlinear variational parameter is literally freshman calculus applied to a quantum mechanical expectation value — the hard work is entirely in constructing correctly.
where: is the true (generally unknown) ground-state energy of the exact Hamiltonian; is the best energy this particular trial family can produce. Reading: the theorem never breaks; it simply tells you that the minimum over is the tightest bound this trial form is capable of giving. A different functional form for could still do better, even with more parameters or none at all — the optimization only searches within the chosen family. For a Coulombic one-electron problem the energy functional built from a hydrogen-like 1s trial function with exponent always separates cleanly into a kinetic piece scaling as and a potential piece scaling linearly in :
where: the term is the kinetic energy expectation value (in hartree, atomic units), the term is the electron-nucleus attraction expectation value, and is the nuclear charge felt directly by the electron in the Hamiltonian (not necessarily equal to itself). Reading: this quadratic-in-, linear-in- structure is the single most important pattern to memorize; it recurs for hydrogen exactly and for helium's screened problem in modified form.
Derivation: hydrogen atom with a floating orbital exponent
Goal. Starting from the trial function for the hydrogen atom's single electron, derive in closed form, minimize it over , and confirm that the variational method recovers the exact hydrogen ground state exactly — the essential sanity check before trusting the method on helium.
Step 1 — Set up the Hamiltonian and trial function. In atomic units (), the hydrogen atom Hamiltonian for a single electron a distance from a proton of charge is
Choose the normalized 1s-type trial function with a free exponent (not fixed at 1 in advance):
This is a legitimate trial function: it is nodeless, decays to zero at infinity, and is spherically symmetric like the true ground state. The normalization constant is fixed by requiring , using the standard result , which gives .
Step 2 — Evaluate the kinetic energy expectation value. For a function of the form , the standard result (derivable via the radial Laplacian, or looked up from any table of hydrogenic integrals) is
This comes from writing the radial kinetic energy operator acting on , integrating by parts once so that only first derivatives appear (avoiding the delta-function subtlety at the origin), and using the same radial integral together with for the resulting terms. The clean scaling is not a coincidence: kinetic energy always scales as the square of an inverse length, and is the natural length scale of this trial function.
Step 3 — Evaluate the potential energy expectation value. The electron-nucleus attraction expectation value is
Using :
So the attraction scales exactly linearly in , again as expected on dimensional grounds: scales as (inverse length), and the interaction is proportional to that.
Step 4 — Assemble and minimize. Adding the two pieces:
Differentiate and set to zero:
The second derivative is , confirming a genuine minimum, not a saddle point or maximum.
Step 5 — Evaluate the optimized energy and compare to the exact answer. Substituting back,
This is exactly the known exact ground-state energy of the hydrogen atom, hartree eV, and reproduces the exact hydrogenic wavefunction . This exact agreement is not an accident of luck — it occurs precisely because the trial family happens to contain the true ground-state solution as one of its members (at ), so the variational search finds the true answer sitting inside the family it searched. This is the essential control experiment: before trusting the method on a problem without an exact answer (helium), you must first confirm it reproduces a known exact answer perfectly when the trial family is rich enough to contain it.
Derivation: helium atom with a screened hydrogenic product function
Goal. Use a product trial function of two hydrogen-like 1s orbitals sharing a common variational exponent , include the electron-electron repulsion term exactly, minimize the resulting energy expression, and interpret the optimal as an effective nuclear charge.
Step 1 — Set up the Hamiltonian and trial function. The helium atom Hamiltonian (nucleus fixed at the origin, charge , electrons labeled 1 and 2) is
The trial wavefunction is a simple orbital product, ignoring for now electron correlation beyond what a shared screening constant can capture:
Both electrons occupy the same orbital with the same exponent ; this is the crucial simplifying assumption. Physically represents an effective charge each electron feels — reduced from the bare because the other electron's density partially cancels (screens) the nuclear attraction.
Step 2 — Evaluate the one-electron kinetic and nuclear-attraction terms. Because the trial function is a simple product and the Hamiltonian's one-electron operators act on each coordinate separately, the kinetic energy expectation value is just twice the hydrogen-like result derived above:
For the nuclear attraction, note the Hamiltonian has nuclear charge (not ) — the exponent is a trial parameter, distinct from the actual charge in . Reusing the Step 3 result from the hydrogen derivation, but now with attraction strength acting on an orbital of exponent :
This is the key place where (orbital shape) and (actual nuclear charge in the Hamiltonian) must be kept distinct — conflating them is the single most common algebra error in this calculation.
Step 3 — Evaluate the electron-electron repulsion integral. This is the genuinely new piece, absent from the hydrogen problem. The two-electron Coulomb repulsion integral for two 1s-type orbitals of common exponent is a classic result:
Evaluating this six-dimensional integral (by expanding in Legendre polynomials and integrating the angular parts to zero except the term, then doing the remaining double radial integral) gives the closed-form result
This scaling — linear in , with coefficient exactly — is one of the standard results of atomic structure theory and is worth memorizing: for two electrons in the same 1s-type orbital of exponent , the average repulsion energy is hartree.
Step 4 — Assemble the total energy functional. Collecting kinetic, nuclear attraction, and repulsion terms:
Here the two linear-in- contributions have been combined: . Already the structure is illuminating: the coefficient is what remains of the bare attraction after the repulsion term has clawed back of a unit of charge-times-exponent — a first quantitative glimpse of screening.
Step 5 — Minimize over . Differentiate:
Solve:
The second derivative confirms a true minimum. Note immediately that : the optimal orbital exponent is smaller than the bare nuclear charge, meaning the optimized orbital is more diffuse than a naive unscreened hydrogenic orbital with would be. Each electron, on average, shields units of nuclear charge from the other — this is the celebrated screening constant of helium's simplest variational treatment.
Step 6 — Evaluate the optimized energy. Substitute back into . It is cleanest to write :
Converting to electron volts using hartree eV gives eV. Comparing to the experimentally determined helium ground-state energy of hartree ( eV), the simple one-parameter screened variational treatment recovers
of the true binding energy — a remarkably good result from a one-parameter trial function, entirely because the parameter was allowed to relax to its physically meaningful screened value rather than being pinned at the bare nuclear charge.
Worked examples
Example 1 (foundational) — reproduce the hydrogen exponent optimization with explicit numeric bookkeeping. Suppose you did not trust the closed-form kinetic and potential integrals and instead wanted to check the result at a nearby, deliberately non-round trial value, say , and confirm the energy lies above the optimum at . Using :
Compare to hartree exactly. Indeed , consistent with the variational theorem: any non-optimal gives an energy above the true minimum. Try the other side, :
Again . Both a smaller and a larger than the optimum give a worse (higher) energy, confirming the shape of the parabola-like curve and the location of its unique minimum at . This numeric bracket is the standard way to build confidence in a closed-form optimization before trusting it on a harder problem.
Example 2 (applied) — estimate the ionization energy of helium from the screened variational energy. The first ionization energy of helium is defined as the energy to remove one electron, leaving , which is a hydrogen-like ion with and exact ground-state energy
Using the variational helium ground-state energy from the derivation above, hartree, the estimated first ionization energy is
Converting using hartree eV:
The experimental first ionization energy of helium is eV. The variational estimate is low by about eV, or roughly — the error stems entirely from the simple trial function's failure to capture electron correlation (the tendency of electrons to actively avoid each other beyond what a shared mean-field exponent can encode) and from restricting to its exact value while treating He only approximately, an asymmetric treatment that exaggerates the apparent gap. Nonetheless a one-parameter, back-of-envelope calculation predicting an ionization energy within about 6% of experiment is a genuine success of the method, not a coincidence.
Example 3 (exam / competition level) — a trial function with an independently variable screening constant distinguishing nuclear attraction from orbital shape. A sharper trial function sometimes used treats the screening as its own parameter , writing the orbital exponent as and asking for the optimal screening constant directly, holding fixed at the true nuclear charge. Show that this reparametrization reproduces the same physics as directly optimizing , and find for helium. Starting from (the general form of the Step 4 result above, generalized to arbitrary rather than fixing immediately — check: setting recovers as before). Substitute :
Differentiate with respect to (note , so chain rule flips signs relative to differentiating in directly):
Solve for , i.e. for :
This exactly matches the screening deduced earlier by inspection (), confirming that reparametrizing the same one-parameter family in terms of a screening constant rather than an orbital exponent is merely a change of variable — the physics and the optimum energy are identical, only the labeling of the free parameter differs. This is an important general lesson: the optimized energy from a single-parameter variational search is a property of the trial family, not of how you choose to write the parameter down. For a general two-electron ion of nuclear charge (isoelectronic with helium, e.g. , ), the same algebra gives and
For (Li), this predicts hartree, compared to the experimental value of hartree — again an error of well under 1%, and the same functional form scales smoothly across the isoelectronic series without any new derivation required.
Limiting cases, scope & common traps
| Regime / check | What happens | Why |
|---|---|---|
| Hydrogen, exact family contains true solution | , hartree exactly | The trial family contains the true ground state at ; variational search finds it exactly |
| Helium, product trial function, no repulsion term (hypothetically set ) | Optimal , hartree | Without repulsion the two electrons behave as two independent hydrogenic electrons in a field, each with exact energy |
| Helium, full treatment with repulsion | Repulsion pushes electrons apart on average; the orbital relaxes outward (smaller exponent) to reduce kinetic energy cost of the compromise | |
| (very high nuclear charge, two-electron ion) | Screening constant stays fixed; | Repulsion becomes a vanishingly small fraction of the total energy as grows, since attraction scales as but repulsion only as |
| Comparing variational and exact energies | Variational energy is always exact energy | This is the content of the variational theorem itself — it cannot be violated by any choice of trial function or parameter |
| Adding more parameters (foreshadowing) | Lower energy is achievable, e.g. two different exponents for the two electrons, or explicit terms | More flexible trial families can only match or beat a less flexible one; this motivates Linear Variation and Secular Equations for handling multiple simultaneous parameters systematically |
The chemist behind it
The idea of optimizing a variational trial function with a floating exponent traces most directly to work in the 1920s and 1930s applying the newly formulated Schrödinger equation to atoms beyond hydrogen. The single individual most associated with the practical machinery of orbital exponents and screening constants is John C. Slater, whose empirical rules for effective nuclear charge (Slater's rules, still taught today) were a direct simplification and generalization of exactly the kind of exponent-optimization calculation carried out above for helium. Slater worked in an era when quantum mechanics was barely a decade old and multi-electron atoms seemed forbiddingly difficult; his insight was that a huge amount of atomic and molecular structure could be captured by treating orbital exponents as adjustable, physically meaningful parameters rather than fixed hydrogenic values, laying groundwork that later matured into the Slater-type orbital basis functions used throughout quantum chemistry.
Origins · 1 minJohn Clarke Slater and how this was discovered
Slater trained at Harvard and worked briefly with Bohr and Kramers in Copenhagen before returning to build one of the most productive American schools of theoretical physics and chemistry at MIT. He contributed the Slater determinant (enforcing antisymmetry in multi-electron wavefunctions), Slater-type orbitals (exponential radial functions used as basis sets, directly generalizing the trial functions used here), and Slater's rules for estimating effective nuclear charge — an empirical shortcut for exactly the kind of screening constant derived rigorously above for helium. His work bridged atomic spectroscopy, molecular electronic structure, and eventually solid-state band theory, and remains foundational to how chemists still estimate orbital energies and sizes by hand.
Why does optimizing a nonlinear parameter differ from the "linear variation" method mentioned as a follow-up topic?
In nonlinear parameter optimization, the trial function's functional form itself depends on the parameter — changing reshapes every point of the wavefunction simultaneously and nonlinearly, so the energy is generally not a simple polynomial ratio and must be minimized with ordinary calculus (setting ). In linear variation, by contrast, you fix a set of basis functions once and for all, and vary only the linear expansion coefficients multiplying them; because the Hamiltonian expectation value is then a quadratic form in those coefficients, the minimization reduces to solving a matrix eigenvalue problem (the secular equation) rather than a general calculus problem. Many practical calculations combine both: basis function exponents are optimized nonlinearly first, then held fixed while linear coefficients are optimized via the secular equation machinery.
Could you optimize two different exponents for helium's two electrons instead of forcing them to share one value?
Yes, and doing so improves the energy, though the improvement from this particular relaxation is modest since both electrons occupy the same 1s-type orbital shape by symmetry in the true ground state, so a shared exponent already captures most of the available flexibility. The larger improvements come from adding genuinely new physics: an explicit -dependent correlation term (as Hylleraas did in 1929, reaching accuracy of a few parts in ten thousand), or using two different orbital shapes with a linear combination (a step toward configuration interaction). The one-shared-exponent calculation is deliberately the simplest nontrivial case, chosen because it is solvable by hand while still recovering the essential screening physics.
Why is the kinetic energy term always proportional to ζ² and the attraction term always proportional to ζ for exponential trial functions?
This follows from dimensional analysis combined with the scaling behavior of the exponential function. The parameter has units of inverse length, and sets the characteristic size of the electron cloud. Kinetic energy, via the uncertainty principle, scales as the inverse square of the characteristic length, hence as . The Coulomb attraction energy scales as the inverse of the characteristic length (charge over distance), hence as . This scaling argument, independent of computing any actual integral, immediately tells you the shape of — a upward-opening parabola in shifted by a linear term — before you do any calculus, which is a useful check on any actual derivation.
Does this method work for excited states as well as ground states?
The basic variational theorem as stated strictly guarantees an upper bound only for the ground state, since it relies on expanding the trial function in the true eigenbasis and using that every eigenvalue except the lowest contributes a nonnegative excess. For excited states, a modified version works if the trial function is constrained to be orthogonal to all lower-energy exact eigenfunctions (which is often impractical since those functions are unknown), or if symmetry alone guarantees orthogonality (for example, optimizing a -orbital-shaped trial function for an excited state of hydrogen, which is automatically orthogonal to the ground state by angular symmetry). Nonlinear parameter optimization is most reliably and most commonly applied to ground states for exactly this reason.
Why is the resulting helium energy still 2% off rather than exact, given how much algebra went into it?
The 2% residual gap is not due to any error in the optimization procedure — the calculus is exact and the integrals are evaluated exactly — but to a genuine limitation of the trial function's functional form. A simple product of two identical 1s-type orbitals cannot capture electron correlation: the instantaneous tendency of the two electrons to avoid each other beyond what a shared, static screening constant can encode. The true wavefunction has the electrons dynamically dodging one another at each instant, which requires either an explicit term in the trial function or a linear combination of many orbital products (configuration interaction) to represent. The one-parameter method is exact within its family; it is simply not a rich enough family to reach the true answer exactly.
How does this connect to Slater's rules taught in general chemistry for estimating effective nuclear charge?
Slater's rules are an empirical, hand-computable approximation to exactly the kind of rigorous exponent-optimization calculation done here for helium. Rather than solving a repulsion integral and differentiating, Slater's rules assign fixed screening contributions based on which shell and subshell other electrons occupy (for instance, 0.35 for another electron in the same shell), producing an estimated effective nuclear charge without any calculus. For helium, Slater's rules give a screening constant of (two 1s electrons, each contributing shielding to the other under the standard same-shell rule), giving — remarkably close to the rigorously derived from the variational calculation above, showing that the empirical rule is genuinely tracking the same underlying physics that the full derivation makes exact.