Fourier Series

Fourier series represent any reasonable periodic function as an infinite sum of sines and cosines (or complex exponentials). Key result: a function of period that is piecewise smooth equals , with coefficients given by integrals against the trig functions. Applies to: signal processing, heat conduction, vibrations, electrical engineering, quantum mechanics, number theory. Who/when: Joseph Fourier (1807, in his study of heat), building on Euler, Bernoulli, and d'Alembert.

A Fourier series is the expansion of a periodic function into a (possibly infinite) linear combination of harmonically related sinusoids, whose frequencies are integer multiples of a fundamental frequency. Its importance is foundational: it asserts that the trigonometric system forms a complete orthogonal basis for square-integrable periodic functions, so that nearly any periodic signal — including discontinuous ones like square waves — can be reconstructed from elementary oscillations. This matters because differentiation and convolution become algebraic operations on the coefficients, transforming differential equations into solvable arithmetic. The surprising fact, fiercely contested in the early 19th century, is that a sum of perfectly smooth, infinitely differentiable sines can converge to a function with sharp corners or jumps. Even more surprising: the partial sums near a jump always overshoot by about 9% no matter how many terms you take — the Gibbs Phenomenon.

The Core Insight

The sines and cosines are mutually orthogonal over one period: the integral of any two distinct members' product vanishes. This means we can extract each coefficient independently by projecting onto that basis function — exactly like finding the components of a vector along orthogonal axes. The Fourier coefficient is simply "how much of is inside ," measured by an inner product. The whole theory is linear algebra in infinite dimensions.

Formal Statement

Fourier Series of a $2\pi$-Periodic Function

Let be periodic with period and integrable on . Its Fourier series is

1
⟳postulate a trig expansion, then determine coefficients by exploiting orthogonality (see proof below). The symbol denotes "has Fourier series," deferring the question of convergence.

with coefficients

2
⟳multiply [1] by , integrate over , and use for .
3
⟳multiply [1] by and integrate; use .

Here is the mean value (DC component) of , is the harmonic index, are the Fourier coefficients, and is the Kronecker delta. The fundamental angular frequency is (period ); harmonic oscillates times faster.

Complex (Exponential) Form

Using Euler's formula , the series compresses to

4
⟳substitute , into [1]; collect terms to get , , .

For a general period , the angular frequency becomes and

5
⟳rescale the variable to map period onto period .

Dirichlet Convergence Theorem

If is periodic with period and piecewise smooth (piecewise continuous with a piecewise continuous derivative), then for every the Fourier series converges, and

6
⟳write the partial sum as a convolution with the Dirichlet kernel , then apply the Riemann–Lebesgue lemma to the remainder; the kernel's mass-1 property gives the average of one-sided limits.

At points of continuity this equals ; at a jump it converges to the midpoint of the jump.

Parseval's Identity / Completeness

For the trigonometric system is complete, and energy is conserved:

7
⟳expand , substitute the series for one factor, integrate term-by-term using orthogonality. In complex form: .

This identity is the infinite-dimensional Pythagorean theorem.

Why It Holds / Derivation

Coefficient Formulas via Orthogonality

Step 1 — Orthogonality relations. Direct integration using product-to-sum formulas gives, for integers :
Also for , while . Step 2 — Assume the expansion holds and may be integrated term-by-term:
Step 3 — Project onto . Multiply both sides by and integrate over . Every term vanishes by Step 1 except the one with :
Step 4 — The mean. Projecting onto (i.e. ): , recovering . This is why we wrote — so formula [2] holds uniformly for all . Step 5 — Project onto identically yields . Step 6 — Justification of term-by-term integration. For , the partial sums converge in the norm, and the inner product is continuous in that norm, so interchanging sum and integral is valid.

Dirichlet Kernel Sketch of Pointwise Convergence

Step 1. The -th partial sum is , where the Dirichlet kernel is
Step 2. has total integral and concentrates near as , but with oscillating sidelobes (the source of Gibbs overshoot). Step 3. Writing as an integral of against the smooth difference quotient of , the Riemann–Lebesgue lemma (rapidly oscillating integrals of integrable functions vanish) forces this remainder to for piecewise-smooth .

Jean-Baptiste Joseph Fourier | 1768–1830

A French mathematician and physicist who accompanied Napoleon to Egypt and later served as prefect of Isère. In his 1807 memoir and the 1822 treatise Théorie analytique de la chaleur, Fourier solved the heat equation by boldly asserting that any function could be expanded in trigonometric series. The claim scandalized Lagrange, Laplace, and Legendre, whose committee criticized its lack of rigor — yet the method worked spectacularly. Fourier also discovered the greenhouse effect and the dimensional analysis of physical equations. His insistence on the universality of trigonometric expansion forced mathematicians to clarify the very notions of function, integral, and convergence, seeding a century of analysis.

Building Intuition

Think of as a musical chord. A pure tone is a single sine; a real instrument's sound is a sum of harmonics whose relative strengths — the coefficients — define the timbre. Fourier analysis is the ear's job in reverse: given the chord, recover the individual notes.

Geometrically, each basis function is an axis in an infinite-dimensional space, and is a vector. The coefficient is the shadow casts on the axis. Because the axes are perpendicular (orthogonal), each shadow can be measured without interference — that's the whole trick.

Symmetry shortcuts: if is even, all (only cosines survive). If is odd, all (only sines). Smoother functions have coefficients decaying faster: a jump gives decay, a corner , and an infinitely smooth periodic function decays faster than any power — the spectrum reads off the regularity of .

Square wave (gold) and its partial Fourier sums approaching it

<svg viewBox="0 0 520 300" xmlns="http://www.w3.org/2000/svg">
<rect width="520" height="300" fill="#0a0e17"/>
<line x1="30" y1="150" x2="500" y2="150" stroke="#94a3b8" stroke-width="1"/>
<line x1="30" y1="40" x2="30" y2="260" stroke="#94a3b8" stroke-width="1"/>
<text x="505" y="154" fill="#e2e8f0" font-size="12">x</text>
<text x="14" y="44" fill="#e2e8f0" font-size="12">f</text>
<!-- target square wave -->
<polyline points="30,90 265,90 265,210 500,210" fill="none" stroke="#d4a853" stroke-width="2.5"/>
<text x="120" y="80" fill="#d4a853" font-size="12">square wave</text>
<!-- N=1 sine -->
<path d="M30,150 Q147,55 265,150 Q382,245 500,150" fill="none" stroke="#64748b" stroke-width="1.4" stroke-dasharray="4 3"/>
<text x="60" y="125" fill="#64748b" font-size="11">N=1</text>
<!-- N=5 wiggly approximation -->
<path d="M30,150 C60,95 80,95 100,98 C120,100 140,95 160,95 C200,95 230,95 265,95
         C300,205 330,205 370,205 C400,205 440,205 470,202 C485,200 495,180 500,150"
      fill="none" stroke="#e2e8f0" stroke-width="1.6"/>
<text x="300" y="190" fill="#e2e8f0" font-size="11">N=5 (note overshoot)</text>
<!-- Gibbs overshoot markers -->
<circle cx="262" cy="78" r="3" fill="#f87171"/>
<text x="270" y="74" fill="#f87171" font-size="10">Gibbs ~9%</text>
</svg>

Worked Examples

Square Wave

Given: the odd, -periodic square wave . Step 1 — Symmetry. is odd, so all . Step 2 — Sine coefficients.
Step 3 — Evaluate. Since : , which is for even and for odd . Step 4 — Series.
Bonus: evaluating at where gives the Leibniz series .

Parseval Yields $\zeta(2)$

Given: on , extended -periodically (a sawtooth). Find . Step 1 — Coefficients. is odd, so . Integrate by parts:
Step 2 — Apply Parseval [7]. The left side is . Step 3 — Right side. . Step 4 — Solve.
This is the famous Basel problem, solved by Fourier methods in a few lines.

Common Misconceptions

The is not always . A Fourier series need not converge to at every point. At jump discontinuities it converges to the midpoint, not to either one-sided value. There even exist continuous functions whose Fourier series diverge at some points (Du Bois-Reymond, 1873). Pointwise convergence everywhere requires extra hypotheses; convergence (in the energy norm) is what always holds for . Increasing does not eliminate overshoot. Near a jump the partial sums overshoot by a fixed ~8.95% of the jump, no matter how large is — the spike merely narrows. This is the Gibbs Phenomenon, not a numerical error.

Coefficient decay does not guarantee uniform convergence

The series has coefficients and converges pointwise (to the sawtooth on ), yet it does not converge uniformly: the limit is discontinuous at , while every partial sum is continuous, so uniform convergence would force a continuous limit. The Gibbs spikes near never shrink in height. Mere decay is the signature of a jump discontinuity, and uniform convergence is impossible there.

Connections

The Fourier series is the period-restricted ancestor of the Fourier Transform: as the period , the discrete spectrum blurs into a continuous spectrum , and the sum [5] becomes an integral. The orthogonality at its heart is a special case of the spectral theory of self-adjoint operators — the are eigenfunctions of on the circle, linking it to Sturm–Liouville Theory and general Orthogonal Polynomials. Parseval's identity makes the trig system an orthonormal basis of Hilbert Space , placing Fourier analysis squarely inside Functional Analysis. The discrete computational cousin is the Discrete Fourier Transform, evaluated rapidly by the Fast Fourier Transform. Termwise differentiation connects it to solving the Heat Equation and Wave Equation by separation of variables.

Real-World Applications

  1. Audio compression (MP3, AAC): sounds are decomposed into frequency components; inaudible coefficients are discarded, slashing file size.
  2. Image compression (JPEG): uses the closely related discrete cosine transform on 8×8 blocks to concentrate energy in few coefficients.
  3. Heat conduction & PDEs: Fourier's original use — solving the heat equation in a rod or plate by expanding initial temperature profiles in eigenmodes that decay at rate .
  4. Electrical engineering: AC circuit analysis and harmonic distortion measurement; any periodic voltage waveform is a sum of harmonics driving impedances frequency-by-frequency.
  5. Vibration & structural analysis: modal analysis of beams, membranes, and bridges identifies resonant harmonics to avoid catastrophic resonance.
  6. Crystallography: X-ray diffraction patterns are the Fourier coefficients of electron density; inverting them reconstructs molecular structure (how DNA's helix was found).
  7. Magnetic resonance imaging (MRI): the scanner samples the Fourier (k-space) representation of the body; inverse transform yields the image.

Historical Development

  • 1748 — Euler expands functions in trigonometric series while studying vibrating strings, computing some coefficients.
  • 1753 — Daniel Bernoulli argues a vibrating string's motion is a superposition of harmonic modes; d'Alembert and Euler object that this cannot represent arbitrary shapes.
  • 1777 — Euler derives the coefficient integral formulas (the orthogonality trick) in a special context.
  • 1807 — Fourier submits his memoir on heat to the Paris Academy, asserting universal trigonometric expansion; the committee (Lagrange, Laplace, Legendre) withholds the prize over rigor.
  • 1822 — Fourier publishes Théorie analytique de la chaleur, the definitive treatise.
  • 1829 — Dirichlet gives the first rigorous convergence theorem for piecewise-monotonic functions, founding modern analysis of the subject.
  • 1854 — Riemann develops his integral specifically to handle Fourier coefficients of badly behaved functions, in his Habilitation.
  • 1873 — Du Bois-Reymond constructs a continuous function whose Fourier series diverges at a point.
  • 1899 — Gibbs (after Wilbraham, 1848) explains the persistent overshoot at discontinuities; 1907 — Riesz–Fischer establish completeness. 1966 — Carleson proves Fourier series of functions converge almost everywhere.

Subtleties & Limits

Convergence theory contains deep and partly open territory. Carleson's theorem (1966) guarantees almost-everywhere convergence for functions, and Hunt extended it to for ; but Kolmogorov (1923) built an function whose Fourier series diverges everywhere, so is hopeless. The sharp characterization of which continuous functions have everywhere-convergent series, and the precise interplay between coefficient decay rates and pointwise regularity, remains subtle. In higher dimensions, the convergence of multidimensional Fourier series depends delicately on the summation method (spherical vs. rectangular partial sums) — the ball multiplier problem (Fefferman, 1971) shows the disc multiplier is unbounded on for , revealing that naive radial summation fails. Questions about optimal convergence under minimal smoothness, and connections to additive combinatorics via exponential sums, remain active research.

See Also

Fourier Transform · Gibbs Phenomenon · Parseval's Theorem · Heat Equation · Wave Equation · Discrete Fourier Transform · Fast Fourier Transform · Sturm–Liouville Theory · Hilbert Space · Orthogonal Polynomials

Before this

Where this leads