Ordinary Differential Equations

Ordinary Differential Equations (ODEs) are equations relating a function of a single variable to its derivatives. One-line statement: An ODE asks "what function has this relationship between itself and its rates of change?" Key result: Under mild conditions (continuity + Lipschitz), a unique solution exists locally for any initial condition (Picard–Lindelöf). Where it applies: physics, engineering, biology, economics — anywhere a system evolves deterministically in one variable (usually time). Who/when: born with Newton and Leibniz (1670s–1680s); systematized by Euler, the Bernoullis, Cauchy, and Lipschitz through the 18th–19th centuries.

An ordinary differential equation is an equation of the form $F (x, y, y^{'}, \dots, y^{(n)}) = 0$ involving an unknown function $y (x)$ of a single independent variable $x$ and its derivatives up to order $n$ (the order of the equation). It is "ordinary" to distinguish it from a partial differential equation, which involves several independent variables and partial derivatives. ODEs matter because the fundamental laws of nature — Newton's second law, radioactive decay, population dynamics, circuit equations — are naturally stated as relationships between quantities and their rates of change, so solving the ODE recovers the actual behavior of the system over time. A surprising fact: although almost any ODE can be written down, only a measure-zero sliver of them can be solved in closed form with elementary functions — yet we can still prove rigorously that solutions exist, are unique, and depend continuously on the data, which is often all an engineer or physicist needs.

The Core Insight

A differential equation does not hand you a function — it hands you a rule for the slope at every point. The solution is the unique curve that everywhere obeys that rule and threads through a chosen starting point. Geometrically, a first-order ODE $y^{'} = f (x, y)$ paints a direction field on the plane: a tiny arrow of slope $f (x, y)$ at each point. Solving the ODE means finding curves tangent to every arrow they pass through. Existence is the claim that such curves always exist; uniqueness is the claim that through each point passes exactly one.

Formal Statement

Ordinary Differential Equation

An ordinary differential equation of order $n$ in the unknown function $y (x)$ is a relation

F (x, y, \frac{d y}{d x}, \frac{d ^{2} y}{d x ^{2}}, \dots, \frac{d ^{n} y}{d x ^{n}}) = 0,

where $x$ is the independent variable, $y = y (x)$ is the dependent variable (the unknown), $y^{(k)} = d^{k} y / d x^{k}$ is the $k$ -th derivative, and $F$ is a given function. The order $n$ is the highest derivative appearing. The equation is explicit (or in normal form) if it can be solved for the top derivative:

y^{(n)} = f (x, y, y^{'}, \dots, y^{(n - 1)}) .

⟳Equation [2] is just [1] solved algebraically for

y^{(n)}

where the implicit function theorem permits; not every implicit ODE admits a global normal form.

A solution on an interval $I \subseteq R$ is an $n$ -times differentiable function $φ : I \to R$ that turns [1] into an identity for all $x \in I$ .

Linear ODE

An ODE is linear if it can be written

a_{n} (x) y^{(n)} + a_{n - 1} (x) y^{(n - 1)} + \dots + a_{1} (x) y^{'} + a_{0} (x) y = g (x),

with the unknown $y$ and its derivatives appearing only to the first power and not multiplied together. The coefficients $a_{k} (x)$ depend on $x$ alone. If $g (x) \equiv 0$ the equation is homogeneous; otherwise inhomogeneous (or forced). If all $a_{k}$ are constants it has constant coefficients.

⟳Linearity means the left side defines a linear operator

L [y] = \sum_{k} a_{k} (x) y^{(k)}

, so

L [α y_{1} + β y_{2}] = α L [y_{1}] + β L [y_{2}]

Picard–Lindelöf Existence and Uniqueness

Consider the first-order initial value problem (IVP)

y^{'} = f (x, y), y (x_{0}) = y_{0} .

⟳This is [2] for

n = 1

together with one initial datum that pins down the integration constant.

If $f$ is continuous on a rectangle $R = {∣ x - x_{0} ∣ \leq a, ∣ y - y_{0} ∣ \leq b}$ and Lipschitz continuous in $y$ there — meaning there is a constant $L$ with

∣ f (x, y_{1}) - f (x, y_{2}) ∣ \leq L ∣ y_{1} - y_{2} ∣ for all (x, y_{1}), (x, y_{2}) \in R,

then there exists $h > 0$ such that the IVP [4] has a unique solution $y (x)$ on the interval $∣ x - x_{0} ∣ \leq h$ , where $h = min (a, b / M)$ and $M = max_{R} ∣ f ∣$ .

⟳

M

bounds the slope, so over a horizontal span

h

the solution can rise at most

M h \leq b

, staying inside

R

; this is why

h \leq b / M

Why It Holds / Derivation

Picard Iteration — sketch of existence and uniqueness

Step 1 — Reformulate as an integral equation. Integrating [4] from

x_{0}

x

converts the differential problem into a fixed-point problem:

y (x) = y_{0} + \int_{x_{0}}^{x} f (t, y (t)) d t .

⟳Apply the Fundamental Theorem of Calculus to

y^{'} = f

; the integral equation encodes both the ODE and the initial condition in one stroke.

Step 2 — Build the Picard iterates. Define a sequence of approximations starting from the constant

y_{0}

y_{k + 1} (x) = y_{0} + \int_{x_{0}}^{x} f (t, y_{k} (t)) d t, y_{0} (x) = y_{0} .

⟳This is the Banach fixed-point iteration

y_{k + 1} = T [y_{k}]

applied to the operator

T

defined by the right side of [6].

Step 3 — Show the operator is a contraction. Using the Lipschitz bound [5], the distance between successive iterates shrinks:

∥ y_{k + 1} - y_{k} ∥_{\infty} \leq \frac{( L h ) ^{k}}{k !} ∥ y_{1} - y_{0} ∥_{\infty} .

⟳Iterate the inequality

∣ y_{k + 1} - y_{k} ∣ \leq L \int_{x_{0}}^{x} ∣ y_{k} - y_{k - 1} ∣ d t

; each integration introduces another factor of

∣ x - x_{0} ∣ \leq h

and a falling factorial, giving the exponential-series bound.

Step 4 — Conclude convergence. Because

\sum_{k} (L h)^{k} / k! = e^{L h} < \infty

, the series

\sum (y_{k + 1} - y_{k})

converges absolutely and uniformly, so

y_{k} \to y

uniformly. The limit satisfies [6], hence solves [4]. Step 5 — Uniqueness. Suppose

y

and

z

both solve [6]. Then

∣ y - z ∣ (x) \leq L \int_{x_{0}}^{x} ∣ y - z ∣ d t

. By Grönwall's inequality this forces

∣ y - z ∣ \equiv 0

■

Continuity alone gives existence but NOT uniqueness

Peano's theorem guarantees a solution exists whenever

f

is merely continuous. But continuity is too weak for uniqueness — the Lipschitz condition [5] is essential. See the counterexample below.

Augustin-Louis Cauchy | 1789–1857

Cauchy transformed differential equations from a collection of solving tricks into a rigorous theory. Before him, mathematicians asked "what is the formula for the solution?"; Cauchy asked the deeper question "does a solution exist, and is it unique?" — the Cauchy problem (an ODE plus initial data). His method of majorants (1820s) gave the first general existence proof for analytic $f$ . Rudolf Lipschitz (1876) and Émile Picard (1890) later relaxed and streamlined the hypotheses into the iteration scheme above. Cauchy's insistence on $ε$ – $δ$ rigor reshaped all of analysis, but his work on ODEs is where the modern notion of a well-posed problem — existence, uniqueness, continuous dependence — was effectively born.

Building Intuition

Think of $y^{'} = f (x, y)$ as a current in a river. At every point of the $x y$ -plane the function $f$ specifies a flow direction (a slope). Drop a leaf at $(x_{0}, y_{0})$ : it traces out the solution curve, always moving tangent to the local flow. The direction field (or slope field) is a snapshot of all these little arrows. A solution is a streamline. The Lipschitz condition says the flow doesn't change too violently from point to point — if it did, two streamlines could merge or split (non-uniqueness), like water at a singular drain.

For higher-order equations the picture lifts into phase space: an $n$ -th order ODE becomes a first-order system in $n$ variables $(y, y^{'}, \dots, y^{(n - 1)})$ , and a single solution becomes a trajectory through that higher-dimensional space, where again exactly one trajectory passes through each point.

Direction field of $y' = y$ (exponential growth) with three solution curves through different starting points

Worked Examples

Radioactive decay — a first-order linear ODE

Given: A sample of carbon-14 decays at a rate proportional to the amount present, with half-life

T_{1/2} = 5730

years. Initial mass

N_{0} = 10.0

g. Find the mass after

2000

years. Step 1 — Model. "Rate proportional to amount" means

\frac{d N}{d t} = - k N, N (0) = N_{0} .

⟳The minus sign encodes decay;

k > 0

is the decay constant with units

time^{- 1}

Step 2 — Separate variables and integrate.

\int \frac{d N}{N} = - k \int d t ⟹ ln N = - k t + C ⟹ N (t) = N_{0} e^{- k t} .

⟳Separable form

d N / N = - k d t

; exponentiate and use

N (0) = N_{0}

to fix

C

Step 3 — Find $k$ from the half-life.

N (T_{1/2}) = N_{0} /2

gives

k = \frac{ln 2}{T _{1/2}} = \frac{0.6931}{5730} = 1.2097 \times 1 0^{- 4} yr^{- 1} .

⟳Set

e^{- k T_{1/2}} = \frac{1}{2}

and solve.

Step 4 — Evaluate at $t = 2000$ yr.

k t = 1.2097 \times 1 0^{- 4} \times 2000 = 0.24194

, so

e^{- 0.24194} = 0.78511

N (2000) = 10.0 \times 0.78511 = 7.85 g

Damped mass–spring — a second-order linear constant-coefficient ODE

Given: Mass

m = 2.0

kg, damping

c = 4.0

N·s/m, spring constant

k = 10.0

N/m. Released from

x (0) = 0.10

m with

x^{'} (0) = 0

. Find the motion. Step 1 — Newton's law.

m x^{''} + c x^{'} + k x = 0 ⟹ 2 x^{''} + 4 x^{'} + 10 x = 0.

⟳Sum of inertial, damping, and restoring forces equals zero (free vibration).

Step 2 — Characteristic equation. Substitute

x = e^{r t}

2 r^{2} + 4 r + 10 = 0 ⟹ r = \frac{- 4 \pm 16 - 80}{4} = - 1 \pm 2 i .

⟳

e^{r t}

turns derivatives into powers of

r

; the discriminant

< 0

signals oscillation (underdamping).

Step 3 — General solution (complex roots $α \pm β i$ give decaying oscillation).

x (t) = e^{- t} (A cos 2 t + B sin 2 t) .

⟳Real and imaginary parts of

e^{(α + β i) t}

form a real basis

e^{α t} cos β t, e^{α t} sin β t

Step 4 — Apply initial conditions.

x (0) = A = 0.10

. Differentiate and set

t = 0

x^{'} (0) = - A + 2 B = 0 \Rightarrow B = A /2 = 0.05

x (t) = e^{- t} (0.10 cos 2 t + 0.05 sin 2 t) m

The motion is a decaying oscillation with angular frequency $2$ rad/s and decay rate $1 s^{- 1}$ .

Common Misconceptions

Five frequent errors

"More initial conditions are always better." An $n$ -th order ODE needs exactly $n$ conditions. Too few leaves free constants; too many is generally over-determined (no solution).
"The general solution + one condition = unique answer." Only if those conditions are initial (all at one point). Boundary conditions (at two points) can yield zero, one, or infinitely many solutions.
"Separation of variables works for any first-order ODE." It works only when $f (x, y)$ factors as $g (x) h (y)$ .
"Adding particular solutions of different forcings is illegitimate." For linear equations superposition holds; for nonlinear ones it categorically fails.
"A solution exists for all time." Even nice ODEs can blow up in finite time (see below). Picard–Lindelöf is only local.

Continuity without Lipschitz: non-uniqueness

Consider

y^{'} = 3 y^{2/3}, y (0) = 0.

⟳

f (y) = 3 y^{2/3}

is continuous everywhere but its

y

-derivative

2 y^{- 1/3}

blows up at

y = 0

, so it fails the Lipschitz condition [5] there.

This IVP has infinitely many solutions: $y \equiv 0$ , and for any $c \geq 0$ ,

y (x) = {0, (x - c)^{3}, x \leq c, x > c .

Each solution "rests" at zero for an arbitrary time

c

then takes off. Uniqueness fails precisely because Lipschitz fails.

Finite-time blow-up

The harmless-looking IVP

y^{'} = y^{2}, y (0) = 1

⟳Separable:

\int d y / y^{2} = \int d x \Rightarrow - 1/ y = x + C

, with

C = - 1

from the initial datum.

has solution $y (x) = 1/ (1 - x)$ , which escapes to $+ \infty$ as $x \to 1^{-}$ . The solution simply ceases to exist beyond $x = 1$ , even though $f (x, y) = y^{2}$ is smooth everywhere — confirming that Picard–Lindelöf only promises a local interval.

Connections

ODEs sit at the crossroads of nearly all of analysis and applied mathematics.

Linear Algebra — solving a linear system of ODEs $y^{'} = A y$ reduces to finding eigenvalues and eigenvectors of $A$ ; the solution is $y = e^{A t} y_{0}$ via the matrix exponential.
Laplace Transform — converts linear constant-coefficient ODEs (and their initial conditions) into algebraic equations, then inverts.
Power Series Methods — solve ODEs with variable coefficients (e.g. Bessel's, Legendre's equation) by expanding the solution as a series.
Partial Differential Equations — separation of variables reduces a PDE to several coupled ODEs; ODE theory is the foundation.
Dynamical Systems — the qualitative, long-term study of ODE solutions (fixed points, stability, chaos) without solving them explicitly.
Numerical Analysis — when no closed form exists, methods like Euler and Runge–Kutta approximate solutions step by step.

Real-World Applications

Newtonian mechanics — $m \ddot{r} = F$ is a second-order ODE governing every projectile, planet, and pendulum.
RLC electrical circuits — Kirchhoff's voltage law gives $L \overset{q}{¨} + R \overset{q}{˙} + q / C = V (t)$ , identical in form to the damped mass–spring [12].
Pharmacokinetics — drug concentration in the bloodstream follows first-order elimination $\dot{C} = - k_{e} C$ , used to set dosing intervals.
Population biology — the logistic equation $\dot{P} = r P (1 - P / K)$ models bounded growth toward a carrying capacity $K$ .
Newton's law of cooling — $\dot{T} = - k (T - T_{env})$ forecasts how a hot object equilibrates with its surroundings (forensic time-of-death estimates).
Epidemiology (SIR model) — coupled ODEs for Susceptible, Infected, Recovered populations predict outbreak curves and the basic reproduction number $R_{0}$ .
Chemical reaction kinetics — rate laws like $\dot{[A]} = - k [A]^{2}$ determine how fast reactants are consumed and the order of a reaction.

Historical Development

1671–1676 — Isaac Newton, in Method of Fluxions, solves the first differential equations using infinite series and his "fluxional" notation; keeps the work largely private.
1684–1693 — Gottfried Leibniz publishes the $d y / d x$ notation and the term aequatio differentialis; with the Bernoullis he develops separation of variables and the method for first-order linear equations.
1696 — Johann Bernoulli poses the brachistochrone problem, sparking the calculus of variations and the systematic study of ODEs across Europe.
1739–1755 — Leonhard Euler systematizes linear ODEs with constant coefficients via the characteristic equation, introduces the integrating factor, and pioneers numerical (Euler) methods.
1820s — Augustin-Louis Cauchy proves the first general existence theorem (method of majorants) and frames the Cauchy problem, demanding rigor over formula-hunting.
1838 — Joseph Liouville and others establish that most ODEs (e.g. the Riccati equation generically) have no solution in elementary functions — the analogue of unsolvable algebraic equations.
1876 — Rudolf Lipschitz isolates the condition [5] guaranteeing uniqueness.
1890 — Émile Picard perfects the method of successive approximations [7], giving the clean Picard–Lindelöf theorem still taught today.
1890s — Henri Poincaré founds the qualitative theory of ODEs and dynamical systems, studying stability and the three-body problem, anticipating chaos theory.

Subtleties & Limits

Several deep difficulties persist beyond the undergraduate core. (1) Closed-form solvability: there is no algorithm to decide whether a general ODE has an elementary-function solution; differential Galois theory (Picard–Vessiot) partly addresses the linear case but the nonlinear landscape is wide open. (2) Global existence vs. blow-up: for nonlinear systems (e.g. those arising from fluid dynamics), determining whether solutions remain smooth for all time or develop singularities is a major open question — the Navier–Stokes regularity problem (a PDE, but rooted in ODE-style energy estimates) is a Clay Millennium Prize problem. (3) Sensitive dependence and chaos: even simple smooth ODEs (Lorenz system, three-body problem) exhibit dynamics so sensitive to initial conditions that long-term prediction is fundamentally impossible despite deterministic equations. (4) Stiff and singular equations: equations with widely separated time scales defy naive numerical integration, and the theory of singular perturbations remains an active research field.