Generating Functions for Special Functions
A generating function is a single closed-form kernel whose Taylor or Laurent expansion in an auxiliary variable has the members of an entire family of special functions as its coefficients. Read off the coefficient of and you peel one function, , off the family; the other powers of hold the rest. The astonishing fact that makes this a working tool is that for the classical families of mathematical physics — Legendre, Hermite, Laguerre and Chebyshev polynomials, and the Bessel functions — this kernel is elementary: an algebraic root, or an exponential. The whole infinite list is stored in one short formula. That compactness pays off because operations on the family become operations on the kernel. "Shift the index by one" is "multiply by "; "differentiate the whole family" is " of the kernel". Differentiating in and matching coefficients hands you the three-term recurrence in a few lines; differentiating in gives the differential recurrences; substituting a special value of gives values like ; and a contour integral of becomes a Schläfli-type integral representation. One object, worked with elementary calculus, delivers the recurrences, differential equation, and integral forms — for every member at once. The physics is not decoration but the source. The Legendre kernel is literally the inverse distance expanded in the radial ratio — the multipole expansion of the Newtonian and Coulomb potentials. The Bessel kernel is the Jacobi–Anger identity resolving a plane wave into cylindrical partial waves; the Hermite kernel is, up to normalisation, the coherent state of the quantum oscillator. In each case the special functions are the natural expansion coefficients of a familiar physical object, and the generating function is that object wearing its mathematical face.
- A generating function is one closed-form kernel whose power-series coefficients in the dummy variable are the members of a special-function family.
- The same kernel yields, by differentiation and simple algebra in , the recurrence relations, special values, and integral representations of the whole family — no need to work member by member.
- Legendre polynomials come from , which is exactly the multipole expansion of the inverse distance .
- Integer-order Bessel functions come from the Laurent kernel , encoding the Jacobi–Anger plane-wave decomposition.
- Hermite and Laguerre polynomials come from and , tying the harmonic oscillator and the Coulomb radial problem to compact kernels.
- Care is needed on the convergence region of and on the integer-versus-noninteger distinction: a Laurent kernel produces only integer orders.
- Key idea: encode a whole family as the coefficients of one closed-form kernel ; then every recurrence, special value, and integral representation follows from elementary operations on rather than on each separately.
Encode a whole family as the coefficients of one closed-form kernel ; then every recurrence, special value, and integral representation is obtained by elementary operations on rather than on each separately.
Where this lives today
Generating functions are the theoretical licence behind the numerical evaluation of special functions everywhere in computational physics. The three-term recurrences they produce — Bonnet's for Legendre, the pure Hermite relation, the Bessel order-recurrence — are how libraries such as SciPy, GSL, and Boost actually compute , , , and : forward recurrence for polynomials, and Miller's backward recurrence for Bessel functions, both far more stable at large order than any closed form. The multipole side of the same coin became an algorithm: Greengard and Rokhlin's Fast Multipole Method (1987) uses the Legendre and spherical-harmonic multipole expansions to reduce an -body potential sum from to , and now drives astrophysical gravity solvers and molecular-dynamics electrostatics. The Jacobi–Anger expansion is measured in radio engineering: a frequency-modulated signal has a sideband spectrum whose amplitudes are exactly of the modulation index , so the carrier vanishes at the zeros of (the first "carrier null" at is a standard bench calibration). And in quantum optics the Hermite kernel is the oscillator's coherent state, its coefficient structure giving the Poissonian photon statistics behind laser theory and squeezed light.
The physical picture
Think of as a bookkeeping handle and as a master ledger: each power has one special function filed against it, and reading the coefficient of retrieves that member. The first figure makes this literal for the Legendre family, whose kernel is the humble algebraic root .
The kernels are not arbitrary bookkeeping devices; they are physically meaningful objects — an inverse distance, a plane wave, a coherent-state overlap — and the special functions are the coefficients those quantities produce when expanded in a natural small parameter. The second figure shows the flagship case with real numbers: two position vectors separated by an angle, the exact inverse distance, and the Legendre series creeping up to it.
The core equations
The whole subject rests on one definition: a generating function is a power series in an auxiliary variable whose coefficients are the functions you care about. The variable carries no physical meaning of its own.
where: — the generating function (closed-form kernel); — the -th member of the family; — auxiliary expansion variable (a bookkeeping peg, not a physical quantity); — index summed over (Taylor) or (Laurent). Reading: the family is recovered as , and everything below avoids that term-by-term extraction. For the Legendre family the kernel is an algebraic square root — the inverse-distance expansion that generates the multipole series of electrostatics and gravitation.
where: — Legendre polynomial of degree ; — argument, equal to in the multipole context; — radius of convergence (with , the condition ). Reading: identify and and the left side becomes , so the are the multipole coefficients themselves. The Hermite kernel is entire, and the weight in its expansion is the fingerprint of an exponential generating function tied to the harmonic oscillator.
where: — physicists' Hermite polynomial of degree ; the denominator marks this as an exponential generating function. Reading: because the kernel is , differentiating in or just multiplies by a linear factor, so both recurrences fall out in one line each. The Laguerre kernel governs the radial Coulomb problem; its rational exponent makes it the least obvious of the classical kernels.
where: — Laguerre polynomial of degree ; orthogonal with weight on . Reading: differentiate-and-match here gives the recurrence . The Bessel kernel is different in kind: it is a Laurent series, with negative powers of present, producing integer-order functions running over all of .
where: — Bessel function of the first kind, integer order ; — the kernel is singular at , forcing a Laurent rather than Taylor series. Reading: the in the exponent is exactly why only integer orders appear — a Laurent series has no term with non-integer . Setting in the Bessel kernel collapses it to the Jacobi–Anger expansion of a plane wave into cylindrical harmonics.
where: — angular variable; the substitution turns into . Reading: this is a Fourier series whose coefficients are the Bessel functions, so a plane wave incident on a cylinder is automatically a sum of angular-momentum channels labelled by . Finally, because coefficient extraction is a contour integral, every generating function is also an integral representation waiting to be read off by Cauchy.
where: — a closed contour encircling once counterclockwise; the integrand's residue at is precisely the coefficient of . Reading: applied to the Bessel kernel with this gives the classical integral — an integral representation obtained for free.
The goal of this derivation is to show that equation (2) is not an abstract definition but the multipole expansion of the Newtonian and Coulomb potentials: the algebraic root is literally times the inverse distance once the auxiliary variables are given their physical meaning, and the Legendre polynomials are exactly the coefficients that organise a source into monopole, dipole, quadrupole and higher terms. We start from the geometric inverse distance, factor out the larger radius, recognise the kernel, and read off the physics.
Step 1. Write the distance between a field point at and a source point at using the law of cosines, , where is the angle between the two vectors. Why: the potential of a point source is , so this square root is the only object we need to expand.
Step 2. For a field point outside the source (), pull the larger radius out of the root: . Why: this exposes a dimensionless small parameter , which is exactly the convergence variable the generating function needs.
Step 3. Identify and ; the bracket is precisely the Legendre kernel of equation (2). Why: the mathematical identity and the physical expression are now the same object, so the coefficients of the expansion must be the same functions.
Step 4. Expand with (2) to get , the multipole series: is the monopole , the dipole , the quadrupole , and so on. Why: this is why appear everywhere in electrostatics and gravitation — they are the angular shape of each multipole, delivered ready-made by the generating function. *At the exact value is reproduced by the partial sums of the figure, converging as expected for .*
Go deeper · Derivation B · 1 minBonnet's three-term recurrence by differentiating the kernel
The goal here is to demonstrate the signature technique of the whole subject: differentiate the generating function once with respect to the auxiliary variable , clear denominators to get a first-order differential equation in , substitute the series, and match the coefficient of a single power of . The output is Bonnet's recurrence relation, the three-term relation that every numerical library uses to evaluate Legendre polynomials, obtained without ever writing down a single explicitly. The same four moves work for every classical family.
Step 1. Differentiate the Legendre kernel in : , rewriting the power as the power times one factor of the bracket. Why: expressing as a rational multiple of turns an infinite family of relations into one differential equation in .
Step 2. Clear the denominator: , a first-order linear ODE relating and . Why: this single equation secretly contains every recurrence in the family; matching powers of will unpack it.
Step 3. Insert the series and on both sides: . Why: now both sides are explicit power series in , and equating like powers is pure bookkeeping.
Step 4. Collect the coefficient of . The left side contributes ; the right side contributes . Why: the shift of index inside each term is where the recurrence's structure comes from — multiplying by raised each index, exactly the "shift the index" rule.
Step 5. Move everything to one side and simplify: , Bonnet's recurrence. Why: with only and as seeds, this generates the entire family and is numerically far more stable than the closed forms. *For the relation gives , so , the standard Legendre polynomial; higher regenerate and .*
Go deeper · Derivation C · 1 minBessel recurrences and parity from the Laurent kernel
The aim of this derivation is to show that the same differentiate-and-match recipe survives the passage to a Laurent series, and that a discrete symmetry of the Bessel kernel — invariance under — hands over the negative-order relation that would otherwise require the series definition. Together the recurrence and the parity are all one needs to tabulate for every integer order from just and , both from the single kernel with no integral in sight.
Step 1. Differentiate in : , straight from the exponent. Why: as with Legendre, is a simple multiple of , so one relation encodes the whole order-ladder.
Step 2. Substitute the Laurent series on both sides: . Why: negative powers are now in play, but matching a fixed power of still works identically.
Step 3. Match the coefficient of : , i.e. . Why: this is the order-recurrence, the workhorse for stepping up and down in Bessel order.
Step 4. Exploit the kernel's symmetry: replacing leaves the exponent unchanged, so ; expanding the left side gives , and matching powers with yields . Why: a symmetry of the generating function becomes an exact identity among its coefficients, delivering all negative orders for free. *The recurrence at reads , the standard relation; the parity gives , consistent with the tabulated Bessel values.*
Limiting cases
Each classical family corresponds to a distinct closed-form kernel, and recognising the kernel is the whole game — the region of convergence and the orthogonality weight are read off from its analytic type.
| Case | Result | Meaning |
|---|---|---|
| Legendre | Algebraic kernel; the multipole/inverse-distance expansion; orthogonal on with weight . | |
| Hermite (physicists') | Entire in (no radius limit); weight on ; harmonic-oscillator eigenstates. | |
| Laguerre | Rational-exponent kernel; weight on ; radial Coulomb wavefunctions. | |
| Bessel (integer order) | Laurent series (negative powers present); Jacobi–Anger expansion; only integer orders appear. | |
| Chebyshev | Rational kernel; weight on ; . |
Worked examples
1 · Multipole convergence: recovering 1/√3 from the Legendre series (fully worked)
A field point sits at radius and a unit source at , with between them. Use the Legendre generating function to compute and check it against the exact geometric value.
Step 1. Fix the variables. and , so the series (2) converges. The exact distance is , giving the target .
Step 2. Evaluate the Legendre polynomials at : , , , , .
Step 3. Build the partial sums . The terms are , so the running sums (times ) are .
Step 4. Two more terms () give , within of the exact . The convergence is oscillatory (the coefficients alternate in sign) and geometric-fast only because ; a source closer to the field point () converges painfully slowly, which is why multipole expansions are used for well-separated charges. The Legendre series reproduces , term by term as monopole + dipole + quadrupole + ⋯
2 · Building the Hermite polynomials by recurrence (fully worked)
Use only the generating function — never a table — to produce through and verify the differential recurrence .
Step 1. Read the two seeds directly from the kernel's low-order expansion: , so and .
Step 2. Apply the pure recurrence (the Hermite analogue of Bonnet, from Derivation B's method). For : .
Step 3. For : . For : .
Step 4. Check the differential recurrence. , and — they agree. Likewise . Both recurrences are consistent; the entire Hermite family is generated from , and the kernel, with no closed-form evaluation of any polynomial.
3 · A Bessel sum rule from Jacobi–Anger
The plane-wave identity (6) has unit modulus on the left, . Turn this into a normalisation on the Bessel functions and test it numerically at .
Step 1. Take the squared modulus of (6) and average over one period. Since , Parseval's theorem for the Fourier series gives .
Step 2. Fold the negative orders in with the parity (so ): the sum rule becomes .
Step 3. Evaluate at using tabulated values . Then , , , . The running total is , confirming the sum rule — energy conservation for a plane wave in cylindrical channels is nothing but .
Physics of the portrait
The generating function is not one person's theorem but a method that crystallised over 150 years, as each new special function turned out to be the coefficient list of some elementary kernel. The portrait below traces the idea from its combinatorial birth to its role as the organising principle of the whole special-function zoo.
Origins · 1 mingenerating function and how this was discovered
The generating function began as a bookkeeping trick and became a unifying principle. Leonhard Euler used power series in the 1740s to encode integer sequences — the coefficients of count partitions — establishing the core move of storing an infinite list as one analytic object. The physical payoff arrived with potential theory: in 1782 Adrien-Marie Legendre, studying the gravitational attraction of spheroids, expanded the inverse distance and met the polynomials that bear his name as the coefficients of the radial ratio — the multipole expansion, discovered as a generating function before anyone called it that. Pierre-Simon Laplace systematised the method and coined the term fonction génératrice in his 1812 Théorie analytique des probabilités, showing that recurrences, sums, and asymptotics all flow from operations on the kernel. Friedrich Bessel, analysing planetary perturbations in 1824, arrived at the functions through the expansion of , the archetypal Laurent-type generating function; Jacobi and Anger then read the same kernel at as the plane-wave decomposition now named for them. Charles Hermite (1864) and Edmond Laguerre (1879) completed the classical roster with the oscillator and Coulomb polynomials, each defined most cleanly by its exponential kernel, and Ludwig Schläfli recast the coefficient formula as a contour integral, joining generating functions to integral representations. The modern viewpoint is the synthesis of all these strands: the special functions of physics are the coefficient lists of a small handful of elementary kernels, from which recurrences, differential equations, orthogonality, and integral forms all follow.
Going further
Texts. Arfken, Weber & Harris, Mathematical Methods for Physicists, 7th ed., Ch. 15–16 (Legendre, Bessel, Hermite, Laguerre generating functions) · Hassani, Mathematical Physics, 2nd ed., Ch. 8 and Ch. 14 (classical orthogonal polynomials and their kernels) · Stone & Goldbart, Mathematics for Physics, Ch. on special functions · Byron & Fuller, Mathematics of Classical and Quantum Physics, Ch. 6 · Nakahara, Geometry, Topology and Physics (special functions in physical context) · Riley, Hobson & Bence, Mathematical Methods for Physics and Engineering, Ch. 18 · Abramowitz & Stegun, §9, §22, and NIST DLMF §10.35, §18.12 for the authoritative formula list. The key reference values are: Bonnet's recurrence gives , , ; the Hermite chain gives , , with ; the Bessel order-recurrence gives and , and the sum rule ; the multipole series converges to . All numbers quoted are standard textbook values.
Prerequisites. Orthogonal Polynomials: General Theory · Recurrence Relations for Special Functions · The Gamma Function. Leads to. Legendre Polynomials · Bessel Functions of the First and Second Kind · Spherical Harmonics.
Ask the tutor: Ask me to differentiate any of these kernels live and watch a full recurrence relation — Legendre, Hermite, Laguerre, or Bessel — fall out coefficient by coefficient.
What is the difference between an ordinary and an exponential generating function?
An ordinary generating function attaches the family directly to the powers, (the Legendre, Laguerre, and Chebyshev kernels are of this type). An exponential generating function carries a factorial weight, (the Hermite kernel is the classic example). The distinction is not cosmetic: the factorial changes how differentiation in acts on the coefficients, so the recurrence you extract looks slightly different, and exponential generating functions are the natural choice when the family arises from an exponential kernel like . In practice you read the type off the kernel — a bare is ordinary, a is exponential — and adjust the coefficient-matching bookkeeping accordingly.
Why is the auxiliary variable t called "unphysical" if it equals r′/r in the multipole case?
Because has no fixed meaning across families — its physical interpretation, when one exists, is different in every case. For Legendre in the multipole expansion is a ratio of radii; for the Jacobi–Anger form of Bessel is a phase on the unit circle; for Hermite in the oscillator problem tracks a coherent-state displacement. In the pure mathematics of generating functions is just the variable whose powers index the family. The physics enters only when you choose to substitute a physical quantity for , and which quantity depends entirely on the problem.
Do I need to worry about the region of convergence when I use a generating-function identity?
For the derivation, yes; for the final coefficient identity, usually no. The kernel converges only inside a region of — for the Legendre and Laguerre roots, all for the Bessel Laurent series, all for the entire Hermite kernel — and any manipulation of the kernel is legitimate only inside that region. But the identities you extract relate the coefficients , which are individually polynomials or entire functions, and an identity between polynomials proven on an interval holds everywhere by analytic continuation. So Bonnet's recurrence, valid in principle only where , actually holds for all . Respect convergence while working with , then forget it once you have a relation among the .
How does a generating function give an integral representation?
Through Cauchy's coefficient formula, equation (7): the coefficient of in any Laurent series is the contour integral around a small loop about . Feed a generating function into this and you get an integral representation of automatically. For the Bessel kernel with the loop parametrised as , the formula collapses to , the classical Bessel integral, and deforming the same contour produces the Schläfli and Sommerfeld representations used in asymptotics. So integral representations are not a separate theory — they are the generating function read through a contour integral.
Why do numerical libraries use recurrences instead of the closed-form generating function?
Because recurrences are fast and, used in the right direction, numerically stable, while direct summation of a series loses precision at large order. A generating function's real value to a numericist is that it proves the three-term recurrence exists and gives its coefficients. Legendre and Hermite polynomials are evaluated by forward recurrence from the two lowest members; Bessel functions of increasing order are evaluated by Miller's algorithm, running the recurrence backward from a high order (where the unwanted growing solution is suppressed) and normalising at the end with a sum rule like . In every case the generating function is the theoretical backstop and the recurrence is the actual code.
Can every special function be defined by a generating function?
The classical orthogonal polynomials and the integer-order Bessel functions have famously simple kernels, but "generating function" is a flexible notion and most special functions admit some generating relation — often a bilinear one (Mehler's formula for Hermite) rather than the single-variable kernels here. The important caveat is coverage: a Laurent or Taylor kernel indexes its family by integers, so non-integer-order functions (general , the hypergeometric functions) need a different route — a series, an integral, or a differential-equation definition. Generating functions are the most elegant tool when they apply, not a universal definition.