Fourier Series and Periodic Functions
A periodic function repeats — for every — and periodicity is everywhere physics looks: the plucked string, the alternating voltage in a mains circuit, the electron density of a crystal lattice, the temperature around an insulated ring. The Fourier series is the claim that any reasonable function of period is a superposition of pure oscillations whose frequencies are integer multiples of the fundamental . Decomposing a signal into these harmonics is the native language of vibration, diffraction, and every linear wave phenomenon, converting the analytic problem "understand " into the algebraic one "list its amplitudes". The engine underneath is orthogonality. The exponentials are mutually perpendicular under the inner product , and after normalisation they form a complete orthonormal basis of the Hilbert space of square-integrable periodic functions. A Fourier coefficient is then nothing more exotic than a coordinate — the projection of the vector onto one basis axis, exactly as resolving a force into components, but in infinitely many dimensions. Everything else, from Parseval's energy identity to the differentiation rule that diagonalises , is linear algebra read in this basis. Two questions then organise the subject. First, in what sense does the series equal ? Convergence in the mean holds for every function; pointwise convergence needs more, and near a jump the partial sums overshoot by a fixed fraction — the Gibbs phenomenon. Second, letting turns the discrete spectrum into a continuum and the series into the Fourier transform, with Parseval passing into Plancherel. Fourier introduced all of this to solve the heat equation, and it remains the prototype for separation of variables, spectral methods, and every orthogonal-function expansion in physics.
- A function of period expands as an infinite sum of harmonics — and , or complex exponentials — one term per integer multiple of the fundamental frequency .
- Each coefficient is a projection: multiply by the conjugate harmonic and average over one period, exploiting orthogonality.
- The complex form is cleanest — one integral gives , and exponentials multiply trivially.
- Parseval's theorem equates the energy with , so the Fourier basis is an orthonormal coordinate system in which Pythagoras holds.
- Smoothness equals decay: a jump gives , a corner , a smooth periodic function faster than any power — why spectral methods are so accurate.
- Key idea: the harmonics are mutually orthogonal over one period, so a Fourier coefficient is just the projection — Fourier analysis is linear algebra in an infinite-dimensional inner-product space.
Where this lives today
Fourier's ring of iron has become the arithmetic of the digital age. Every JPEG image and MP3 file is stored as truncated Fourier-type coefficients — the discrete cosine transform keeps the perceptually important low harmonics and discards the rest, the smoothness-equals-decay principle used as a compression law. The fast Fourier transform (Cooley–Tukey, 1965) computes these coefficients in operations instead of and is routinely called one of the most important algorithms ever devised; it runs inside every phone's radio and every Wi-Fi link's OFDM modulation. In magnetic-resonance imaging the scanner does not measure the picture at all — it measures its Fourier coefficients in "-space," and an inverse transform reconstructs the anatomy. Spectral methods integrate the equations of weather, climate, and turbulence by advancing each Fourier mode of the flow, exploiting the exponential accuracy smooth fields guarantee. Crystallographers read a protein's structure from the squared Fourier coefficients of its electron density in X-ray spots, and gravitational-wave observatories sift a chirp from noise by comparing power spectra bin by bin, Parseval underwriting the matched filter. Two centuries on, the claim that everything periodic is a sum of pure tones is not a theorem students admire but an instruction processors execute billions of times a second.
The physical picture
Think of a periodic signal as a chord. The Fourier series is the list of pure tones inside it: the fundamental sets the pitch, and the higher harmonics — with their amplitudes and phases — shape the timbre. Reconstructing means stacking those tones back up. The first figure builds a square wave this way, one harmonic at a time, and shows the one stubborn feature no finite stack can smooth out: the overshoot at each jump.
Geometrically the picture is even simpler. is an infinite-dimensional Euclidean space, and the normalised exponentials are perpendicular unit axes: finding drops a perpendicular from onto the -th axis, and Parseval is just Pythagoras, . What the second figure shows is that this coordinate list is not arbitrary — its rate of decay is dictated by the smoothness of . The square wave has jumps, so its amplitudes fall off only as , which is why the Gibbs ears refuse to go away.
Smoothness is the hidden variable: differentiating the series multiplies each by , so a jump decays as , a corner as , and an infinitely differentiable periodic function faster than any power — a smooth curve needs a handful of tones while a sharp edge needs a symphony.
The core equations
There are two equivalent languages for a Fourier series — real trigonometric and complex exponential — with a dictionary between them. We open with the real form, what a first course writes down and an oscilloscope displays: a mean value plus a sum of cosines and sines at every integer multiple of the fundamental.
where: — periodic function, ; — the period; — real cosine and sine amplitudes of harmonic ; — the average, or DC, value over one period. Reading it: the sum rebuilds tone by tone, the fundamental and larger the overtones. The amplitudes are computed, not guessed, by the Euler–Fourier formulas — each an average of against the harmonic it measures, normalised so a pure returns amplitude one.
where: — an integral over any one full period (the start point is immaterial); — the normalisation forced by . Reading it: correlate with a harmonic and average to read off its amount. The complex exponential form is the one professionals use. It merges the twin sums (1) into a single sum over all integers and reduces the two integrals (2) to one.
where: — the complex coefficient of harmonic , carrying amplitude and phase; — any integer, so negative frequencies appear explicitly; — the orthogonal basis function of frequency . Reading it: one integral computes one coordinate of . The two languages are connected by a dictionary: a real cosine–sine pair repackages into a conjugate pair of complex coefficients at , and vice versa.
where: — the conjugate-symmetry relation, which holds if and only if is real-valued. Reading it: a real signal spends two reals per harmonic, an amplitude and a phase. Everything above rests on a single orthonormality relation — the exponentials are perpendicular unit vectors. It is the one integral to memorise, since every coefficient formula and Parseval fall straight out of it.
where: — the Kronecker delta, equal to when and otherwise. Reading it: distinct harmonics average to nothing over a period, so only the matching one survives. Parseval's theorem is the energy accountant. The average of — a power per unit length — equals the sum of the powers carried by the harmonics, with no cross terms because the basis is orthogonal.
where: — energy (power) density; — the power in harmonic . Reading it: total energy is the Pythagorean sum of the mode energies — the norm is basis-independent. Finally, the differentiation rule makes Fourier series indispensable for differential equations: on the exponential basis, is not an operator to invert but a number to multiply.
where: — the derivative of (itself periodic); — the eigenvalue of on harmonic . Reading it: differentiation is diagonal in the Fourier basis, turning a constant-coefficient ODE into algebra, mode by mode.
The goal is to prove that the coefficient integral in equation (3) really extracts a single amplitude from the whole superposition, for exactly the reason that extracts one Cartesian component of a vector. We assume the series converges well enough to integrate term by term, then project it onto one basis exponential and watch orthogonality annihilate every term but one — the calculation that justifies calling a coordinate.
Step 1. Start from the assumed expansion , multiply both sides by the conjugate basis function , and integrate over one period: . Why: projecting onto the -th axis means taking the inner product with the -th basis vector — multiplying by its conjugate and integrating is precisely .
Step 2. Exchange the sum and the integral (legitimate for a uniformly convergent series) and apply the orthonormality relation (5): . Why: each cross term with is an exponential completing a whole number of cycles over the period, so it averages to zero; only the resonant term has a nonzero mean.
Step 3. Collapse the sum against the Kronecker delta, which selects the single term : . This is the boxed result . Why: the delta is the discrete identity — sifting a sum against it returns the one matching entry, exactly as the projection returns one coordinate. *Verified: reduces to the real Euler–Fourier integrals (2) through the dictionary (4); cross-checked against Arfken–Weber–Harris ch. 19 and Riley–Hobson–Bence ch. 12.*
Go deeper · Derivation B · 1 minParseval's theorem from completeness of the basis
The aim is to show that the energy of a signal is the sum of the energies of its harmonics, with no cross terms, and to make explicit that the equality (rather than the mere inequality of Bessel) is a statement of completeness — that the exponentials leave no direction of unrepresented. We expand using two copies of the series, collapse the double sum with orthonormality, and identify what survives as the sawtooth energy check below.
Step 1. Write the energy density as and substitute both expansions: . Why: energy is quadratic in , so it must involve two factors of the series — one for and one for its conjugate , whose exponents carry the opposite sign.
Step 2. Interchange the sums with the integral and apply orthonormality (5) to the product of exponentials: . Why: the double sum is a matrix of all mode–mode products, but orthogonality kills every off-diagonal entry — different harmonics store energy independently.
Step 3. Collapse the diagonal with the delta to get , the boxed identity . Why: that this is an equality and not just (Bessel's inequality) is exactly the completeness of the exponential basis — there is no missing part of hiding outside the span, so no energy is unaccounted for. *Verified: the equivalent real form is ; matches Stone & Goldbart ch. 2 and 8, and is checked numerically against the sawtooth (Basel sum) below.*
Go deeper · Derivation C · 1 minWhy smoothness controls the rate of coefficient decay
The goal is to turn the slogan "smoother functions have faster-decaying coefficients" into a theorem by tracking what repeated integration by parts does to the coefficient integral. Each pass trades a factor of for a derivative of but leaves a boundary term measuring the mismatch at the period's ends — and that term is precisely a discontinuity. The result explains both figures: the square wave's tail and the exponential accuracy of spectral methods.
Step 1. Integrate by parts once, differentiating and integrating the exponential (which brings down ): . Why: integrating the oscillatory factor is what produces the — every integration by parts against a wave of frequency costs the amplitude a factor of .
Step 2. If is continuous and periodic, the boundary term vanishes because and the exponential is -periodic, leaving — one clean power of times the coefficients of . Why: this is the differentiation rule (7) read backwards; each derivative that stays periodic buys one more factor of of decay.
Step 3. Iterate. A function with continuous periodic derivatives gives ; an infinitely smooth periodic function beats every power, for all . But a jump makes the very first boundary term survive, contributing a term that no further integration removes — so a discontinuity pins the decay at . Why: the boundary term is the size of the jump; a discontinuity is a source the smoothing machinery cannot integrate away, which is exactly why the square wave's spectrum crawls down as and its Gibbs ears persist. *Verified: square-wave (jump) versus triangle-wave (corner); consistent with the decay hierarchy in Körner, Fourier Analysis, and Stone & Goldbart ch. 8.*
Limiting cases
Special structures collapse the general series, and the boundaries of the whole framework are themselves instructive.
| Case | Result | Meaning |
|---|---|---|
| Even function | Only cosines survive — a pure cosine expansion. | |
| Odd function | Only sines survive — natural for functions vanishing at the ends. | |
| Real function | Complex coefficients come in conjugate pairs, one amplitude and one phase per harmonic. | |
| Smooth periodic | Faster-than-any-power decay; the series converges uniformly and absolutely. | |
| Jump discontinuity | , series | Slow decay and the Gibbs overshoot; convergence to the midpoint, not either side. |
| Period | Discrete spectrum becomes a continuum: the Fourier transform, with Parseval becoming Plancherel. |
Worked examples
1 · The square wave, the Leibniz series, and Gibbs (fully worked)
Expand the odd square wave on and on , period . Find its coefficients, evaluate at , and quantify the overshoot at the jump.
Step 1. With the harmonics are . Since is odd, all and we need only , doubling the half-range because is even.
Step 2. Integrate: , which is for odd and for even . Hence and . Numerically , , — the spectrum drawn above.
Step 3. Evaluate at , where : runs over odd , so . Rearranging gives the Leibniz series — a first-principles value of falling out of a square wave.
Step 4. The jump at has height (from to ), and the series there converges to the midpoint , not to either value. Near the jump the partial sums peak at times the half-jump — an overshoot of of the half-jump, i.e. of the full jump height. Result: bₙ = 4/(πn) for odd n, the Leibniz sum π/4 = 0.7854, and a Gibbs overshoot of 8.95%.
2 · The sawtooth and the Basel problem (fully worked)
Expand on , period — the sawtooth — then use Parseval to sum .
Step 1. is odd, so and .
Step 2. Integrate by parts: , since . Thus , giving on .
Step 3. Apply Parseval in real form, . The left side is ; the right side is .
Step 4. Equate: , so — the Basel problem, solved by Euler in 1735 and here recovered as a one-line consequence of the energy identity. Result: sawtooth bₙ = 2(−1)ⁿ⁺¹/n, and Parseval yields Σ1/n² = π²/6 = 1.6449.
Physics of the portrait
The Fourier series is where physics learned to trust an infinite sum. Its author was not a pure mathematician but an engineer of empire — a man who followed Napoleon to Egypt, governed a French département, and wrote down the equation of heat and the audacious claim that any temperature profile could be built from sines and cosines.
Origins · 1 minJoseph Fourier and how this was discovered
Jean-Baptiste Joseph Fourier was orphaned young, narrowly escaped the guillotine during the Revolution, and joined Napoleon's 1798 expedition to Egypt as secretary of the Institut d'Égypte. It was afterwards, as prefect of the Isère, that he did his decisive work. In an 1807 memoir on the conduction of heat in solids he introduced both the heat equation and the method that would carry his name: expand the initial temperature distribution as an infinite series of trigonometric functions, and each mode then decays independently in time. The claim that an arbitrary function — even one with corners and jumps — could be so represented struck his examiners as reckless; Lagrange, Laplace, and Legendre withheld full endorsement, and the memoir went unpublished for years. Fourier persevered, and his 1822 treatise Théorie analytique de la chaleur became one of the most influential books in mathematical physics, praised by Maxwell as "a great mathematical poem." The rigorous convergence theory he lacked was supplied by Dirichlet in 1829 and completed only in the twentieth century by the Lebesgue integral and the Riesz–Fischer theorem, which recast his intuition as the completeness of an orthonormal basis in a Hilbert space. He died in Paris in 1830, having turned a problem about a cooling ring of iron into the universal language of waves.
Going further
Texts. Stone & Goldbart, Mathematics for Physics, ch. 2 (function spaces) and ch. 8 (Fourier series) · Arfken, Weber & Harris, Mathematical Methods for Physicists, 7th ed., ch. 19 · Hassani, Mathematical Physics, ch. 8 · Byron & Fuller, Mathematics of Classical and Quantum Physics, ch. 5 · Riley, Hobson & Bence, Mathematical Methods for Physics and Engineering, 3rd ed., ch. 12 · Körner, Fourier Analysis (Cambridge, 1988) for the convergence theory.
Provenance. The coefficient formulas, the orthonormality integral (5), the real–complex dictionary (4), Parseval (6) and the differentiation rule (7) are standard and re-derivable from the single relation ; cross-checked against Stone & Goldbart ch. 8, Arfken–Weber–Harris ch. 19, and Riley–Hobson–Bence ch. 12. A verifier should reconfirm: (i) the orthonormality relation itself; (ii) the square-wave coefficients for odd and the resulting Leibniz sum ; (iii) the sawtooth coefficients and the Parseval-derived Basel sum ; (iv) the Gibbs overshoot , i.e. 8.95% of the jump; (v) the Dirichlet midpoint value at jumps.
Prerequisites. Inner-product (Hilbert) spaces · Riemann/Lebesgue integration · Complex exponentials and Euler's formula. Leads to. Convergence of Fourier Series · The Fourier Transform · Parseval's and Plancherel's Theorems · The Dirac Delta Function · Solving Differential Equations by Transform Methods.
Ask the tutor: Want to see how the same projection idea turns into the Fourier transform, or how Parseval underwrites signal energy and quantum probability — just ask.
Is the Fourier series just an approximation, or does it exactly equal the function
Both, depending on how you read "equal." For any square-integrable periodic function the series converges to in the mean-square sense — the error energy goes to zero — and this is exact, not approximate. Where is smooth it also equals pointwise; the only places the equality can fail pointwise are discontinuities, where the series returns the midpoint of the jump. So a Fourier series is an exact representation of the function as an element of ; the word "approximation" properly refers only to a truncated partial sum .
What actually is the Gibbs phenomenon, and can I get rid of it
Near a jump the partial sums overshoot by a fixed fraction — about 8.95 percent of the jump height — and this overshoot does not shrink as you add terms; it only narrows into an ever-tighter spike beside the jump. It is a genuine feature of truncating an orthogonal expansion of a discontinuous function, not a bug in your arithmetic. You can suppress it by filtering: multiplying the coefficients by a smoothly tapering window (Fejér, Lanczos, or Gaussian σ-factors) trades the overshoot for a slightly blurred edge — which is why signal processors rarely use a raw truncation and why image codecs blend block edges.
When can I differentiate or integrate a Fourier series term by term
Integration is almost always safe: it divides each coefficient by and so speeds the decay, giving a series that converges even faster. Differentiation is the dangerous direction — it multiplies each coefficient by , amplifying high harmonics and possibly destroying convergence. Term-by-term differentiation is valid only when the differentiated series still converges uniformly, requiring continuous and periodic with a well-behaved derivative. A jump in makes the derivative series diverge — the true derivative then contains a Dirac delta at the jump.
Why use complex exponentials when sines and cosines are more intuitive
Because the algebra is far cleaner. Products of exponentials simply add exponents, , whereas products of sines and cosines need trigonometric identities at every step. The exponential form also merges the two integrals for and into one formula for and makes the differentiation rule a single multiplication by ; for real signals you recover the sine–cosine picture through . Physically is the natural object — the eigenfunction of translation and of , which is why it diagonalises every constant-coefficient linear operator.
What does it mean that the exponentials form a complete basis
Completeness means the exponentials span all of — the only square-integrable periodic function orthogonal to every one of them is zero. Practically, it guarantees that the Fourier series of actually reconstructs (in the mean-square sense) rather than only some projection of it, and it is what upgrades Bessel's inequality to Parseval's equality — without it, energy in could hide where no harmonic captures it. The completeness of the trigonometric system was the hard analytic fact that took a century to establish rigorously, culminating in the Riesz–Fischer theorem of 1907.
How does the Fourier series become the Fourier transform
Let the period grow without bound. The allowed frequencies are spaced by , so as that spacing shrinks to zero and the discrete comb of harmonics fills in to a continuum. The sum becomes an integral , the coefficient becomes the spectral density , and Parseval's sum becomes Plancherel's integral . This is the precise sense in which a Fourier series is the periodic special case of the Fourier transform, and why a non-periodic pulse has a continuous spectrum rather than discrete lines.