Sequences and the Idea of Convergence

What does it mean to say that a list of numbers "gets close to" some target value forever? Consider the sequence 1,1.4,1.41,1.414,1.4142,…1, 1.4, 1.41, 1.414, 1.4142, \ldots. These are the successive decimal truncations of 2\sqrt{2}. Each term is a rational number. Yet the list seems to be homing in on an irrational target. Making this feeling of "homing in" precise matters. We should not rely on intuition alone. Doing so is one of the founding acts of rigorous analysis. This matters because calculus is built on limiting processes. Derivatives are limits of difference quotients. Integrals are limits of Riemann sums. Infinite series are limits of partial sums. Before any of that machinery can be trusted, we need an airtight meaning. We must define precisely what it means for terms to "approach LL." A sequence is nothing more exotic than a function whose domain is the natural numbers. But organizing our thinking this way matters greatly. It lets us bring the completeness of the real numbers to bear. This helps us determine where a sequence is heading. The big picture is this: a sequence of real numbers converges to a limit LL. This happens if its terms can be made to lie arbitrarily close to LL. This must hold for all sufficiently large indices. This article develops that idea carefully but informally. It builds the intuitive picture first. Then it proves the basic uniqueness and boundedness facts. Any sensible definition of convergence must satisfy these facts. Only after that does the fully quantified ε\varepsilon–NN language take over. This language becomes the working definition in the sequel. By the end, you will be able to state precisely what a sequence is. You will reason correctly about what "arbitrarily close" must mean. And you will see why a rigorous definition is unavoidable. This is true if we want theorems, not just pictures, about limits.

Key takeaways
  • A sequence is simply a function a:N→Ra: \mathbb{N} \to \mathbb{R}; we write its values as a1,a2,a3,…a_1, a_2, a_3, \ldots instead of using function notation.
  • Convergence means the terms eventually stay as close as we like to a fixed real number LL, called the limit.
  • The phrase "as close as we like, eventually" is not vague poetry — it is a precise mathematical claim once quantified with ε\varepsilon and NN.
  • A convergent sequence has a unique limit, and every convergent sequence is bounded; these are the first theorems any correct definition must satisfy.
  • Not every sequence converges: oscillating or unbounded sequences are the standard counterexamples.
  • Key idea: convergence packages the informal picture of "getting arbitrarily close forever" into a single testable inequality that must hold for all large indices.

Where this lives today

The concept of a convergent sequence is the load-bearing wall of essentially all of analysis. Derivatives are defined as limits of sequences of difference quotients; the definite integral is the limit of a sequence of Riemann sums as partitions refine; and an infinite series ∑an\sum a_n is defined to converge exactly when its sequence of partial sums converges, linking this article directly to the theory of Infinite Series and Partial Sums. Beyond calculus proper, sequence convergence underlies numerical analysis: iterative algorithms such as Newton's method or gradient descent generate sequences of approximations, and proving that an algorithm "works" means proving the generated sequence converges to the true solution, often with an estimated rate. In probability and statistics, the Law of Large Numbers and the Central Limit Theorem are precisely statements about convergence of sequences of random variables (in various technical senses built on this same skeleton). In computer science, the convergence of iterative methods underlies floating-point root-finding, machine learning optimizers, and fixed-point computations in program semantics. Even in physics and engineering, convergent sequences model discretized approximations to continuous systems — finite-difference schemes for differential equations are trusted only once one has proved the corresponding sequence of approximate solutions converges to the true one as the mesh is refined.

Ask the tutor: How exactly does the ε\varepsilon–NN definition get used to prove convergence for a brand-new sequence I haven't seen before?

DefinitionSequence and Convergence (informal statement)

A sequence of real numbers is a function

a:N→R,n↦an,a : \mathbb{N} \to \mathbb{R}, \qquad n \mapsto a_n,

where N={1,2,3,…}\mathbb{N} = \{1, 2, 3, \ldots\}. We denote the sequence by (an)n=1∞(a_n)_{n=1}^{\infty}, or simply (an)(a_n), rather than writing a(n)a(n). We say the sequence (an)(a_n) converges to a real number LL, and write

lim⁡n→∞an=Loran→L,\lim_{n \to \infty} a_n = L \qquad \text{or} \qquad a_n \to L,

if the terms ana_n get and stay arbitrarily close to LL as nn grows: for every margin of error, no matter how small, there is a point in the sequence beyond which every term lies within that margin of LL. A sequence that converges to some real number is called convergent; otherwise it is called divergent. This description will be made fully precise — quantified with an ε\varepsilon and an NN — as the formal working definition used throughout analysis. For now we treat "arbitrarily close, eventually" as an idea to be sharpened, and we verify that it already forces two structural facts: uniqueness of the limit, and boundedness of any convergent sequence.

Intuition

Picture the real number line, and mark the candidate limit LL as a fixed point. Around LL, draw an interval of radius ε>0\varepsilon > 0 — a "tolerance window" (L−ε,L+ε)(L - \varepsilon, L + \varepsilon). The claim "an→La_n \to L" says: no matter how thin you make this window, the sequence eventually enters it and never leaves. Terms are allowed to wander outside the window at the start (small nn), but only finitely many can do so; from some index NN onward, every single term ana_n must lie strictly inside the window. The subtlety, and the reason a rigorous definition is unavoidable, is the order of the quantifiers. The window comes first — chosen by an adversary who can make it as small as they like — and then we must find an NN that works for that particular window. If instead we fixed NN first and asked for a window to work afterward, the whole notion would collapse into something trivial. This is the single most important logical subtlety in the definition of a limit, and it is worth sitting with before moving to formal symbols. A second useful picture: plot the points (n,an)(n, a_n) in the plane. Convergence to LL means that, however thin a horizontal strip you draw around the line y=Ly = L, the plotted points eventually all fall inside that strip and stay there forever afterward.

Figure
The tolerance window around a candidate limit LL: terms eventually stay inside (L−ε,L+ε)(L-\varepsilon, L+\varepsilon) for all n≥Nn \ge N.
n a_n L L + ε L - ε N terms before N (may wander) terms after N: all inside the band

Formalizing the picture

Before any theorem can be proved, "arbitrarily close, eventually" must be translated into a statement built from real numbers and inequalities — nothing else. The translation is: > For every ε>0\varepsilon > 0, there exists N∈NN \in \mathbb{N} such that for all n≥Nn \ge N, ∣an−L∣<ε|a_n - L| < \varepsilon. Here ε\varepsilon (Greek epsilon) plays the role of the tolerance, and NN is the index beyond which the sequence must stay inside that tolerance. This is the celebrated ε\varepsilon–NN definition, which we will use as our working definition below (it is exactly the precise version of the informal Definition above, and the sequel article develops it in full depth). We adopt it now because the theorems of this article genuinely require a precise object to reason about — no theorem can be proved from a vague picture.

TheoremUniqueness of Limits

Let (an)(a_n) be a sequence of real numbers. If an→L1a_n \to L_1 and an→L2a_n \to L_2, then L1=L2L_1 = L_2.

Hypotheses made explicit: (an)(a_n) is a sequence of real numbers; L1,L2∈RL_1, L_2 \in \mathbb{R}; both L1L_1 and L2L_2 satisfy the ε\varepsilon–NN convergence condition for the same sequence (an)(a_n).

Proof

We argue by contradiction — the standard technique for uniqueness statements. Suppose, for contradiction, that L1≠L2L_1 \ne L_2. Let

ε=∣L1−L2∣2>0,\varepsilon = \frac{|L_1 - L_2|}{2} > 0,

which is a strictly positive real number since L1≠L2L_1 \neq L_2. Since an→L1a_n \to L_1, applying the definition of convergence with this specific ε\varepsilon, there exists N1∈NN_1 \in \mathbb{N} such that

∣an−L1∣<εfor all n≥N1.|a_n - L_1| < \varepsilon \qquad \text{for all } n \ge N_1.

Since an→L2a_n \to L_2, applying the definition again with the same ε\varepsilon, there exists N2∈NN_2 \in \mathbb{N} such that

∣an−L2∣<εfor all n≥N2.|a_n - L_2| < \varepsilon \qquad \text{for all } n \ge N_2.

Let N=max⁡(N1,N2)N = \max(N_1, N_2). This is a natural number, and for n=Nn = N both inequalities above hold simultaneously, since N≥N1N \ge N_1 and N≥N2N \ge N_2. Thus

∣aN−L1∣<εand∣aN−L2∣<ε.|a_N - L_1| < \varepsilon \qquad \text{and} \qquad |a_N - L_2| < \varepsilon.

Now apply the triangle inequality:

∣L1−L2∣=∣(L1−aN)+(aN−L2)∣≤∣L1−aN∣+∣aN−L2∣<ε+ε=2ε=∣L1−L2∣.|L_1 - L_2| = |(L_1 - a_N) + (a_N - L_2)| \le |L_1 - a_N| + |a_N - L_2| < \varepsilon + \varepsilon = 2\varepsilon = |L_1 - L_2|.

This gives ∣L1−L2∣<∣L1−L2∣|L_1 - L_2| < |L_1 - L_2|, which is false for any real number (a number cannot be strictly less than itself). This is a contradiction. Therefore the assumption L1≠L2L_1 \ne L_2 is untenable, and we conclude L1=L2L_1 = L_2. ■\blacksquare

∎
TheoremConvergent Sequences Are Bounded

Let (an)(a_n) be a sequence of real numbers that converges to some limit L∈RL \in \mathbb{R}. Then (an)(a_n) is bounded: there exists M>0M > 0 such that ∣an∣≤M|a_n| \le M for every n∈Nn \in \mathbb{N}.

Hypotheses made explicit: (an)(a_n) is a real sequence; (an)(a_n) converges (to some real LL) in the ε\varepsilon–NN sense.

Proof

This is a direct proof using the definition of convergence with a specific, cleverly chosen ε\varepsilon, followed by a finite maximum argument. Since an→La_n \to L, apply the definition of convergence with the particular choice ε=1\varepsilon = 1 (any fixed positive number works; 11 is convenient). There exists N∈NN \in \mathbb{N} such that

∣an−L∣<1for all n≥N.|a_n - L| < 1 \qquad \text{for all } n \ge N.

For such nn, the triangle inequality gives

∣an∣=∣(an−L)+L∣≤∣an−L∣+∣L∣<1+∣L∣.|a_n| = |(a_n - L) + L| \le |a_n - L| + |L| < 1 + |L|.

So every term from index NN onward is bounded in absolute value by 1+∣L∣1 + |L|. It remains to control the finitely many terms a1,a2,…,aN−1a_1, a_2, \ldots, a_{N-1} that occur before index NN — the definition of convergence says nothing about them directly, but there are only finitely many, so we may simply take the largest of their absolute values. Define

M=max⁡{ ∣a1∣,∣a2∣,…,∣aN−1∣, 1+∣L∣ }.M = \max\{\,|a_1|, |a_2|, \ldots, |a_{N-1}|,\ 1 + |L|\,\}.

This maximum exists because it is a maximum of a finite set of real numbers (finitely many terms a1,…,aN−1a_1,\dots,a_{N-1}, plus the one number 1+∣L∣1+|L|), and every finite nonempty set of real numbers has a maximum. We now check ∣an∣≤M|a_n| \le M for every n∈Nn \in \mathbb{N}:

  • If n<Nn < N, i.e. n∈{1,…,N−1}n \in \{1, \ldots, N-1\}, then ∣an∣|a_n| is one of the terms explicitly included in the maximum defining MM, so ∣an∣≤M|a_n| \le M.
  • If n≥Nn \ge N, then ∣an∣<1+∣L∣≤M|a_n| < 1 + |L| \le M by the computation above.

In either case ∣an∣≤M|a_n| \le M, so (an)(a_n) is bounded by MM. ■\blacksquare

∎
CorollaryContrapositive form: unbounded implies divergent

If a sequence (an)(a_n) is unbounded, then (an)(a_n) diverges (does not converge to any real number).

This corollary is logically just the contrapositive of the Boundedness Theorem, and requires no separate proof: it is the same implication read in the opposite direction.

Worked examples

Example 1 — a convergent sequence with an asymmetric, non-obvious limit. Consider

an=3n2−5n+17n2+2n−4,n≥1.a_n = \frac{3n^2 - 5n + 1}{7n^2 + 2n - 4}, \qquad n \ge 1.

We claim an→37a_n \to \dfrac{3}{7}. Computing the gap. For n≥1n \ge 1 the denominator 7n2+2n−47n^2 + 2n - 4 is positive (check n=1n=1: 7+2−4=5>07+2-4=5>0, and it only grows), so division is valid. Compute

an−37=7(3n2−5n+1)−3(7n2+2n−4)7(7n2+2n−4)=−41n+197(7n2+2n−4).a_n - \frac{3}{7} = \frac{7(3n^2 - 5n + 1) - 3(7n^2 + 2n - 4)}{7(7n^2 + 2n - 4)} = \frac{-41n + 19}{7(7n^2+2n-4)}.

Numerically at n=5n = 5: a5=3(25)−25+17(25)+10−4=75−25+1175+10−4=51181≈0.28177a_5 = \dfrac{3(25) - 25 + 1}{7(25) + 10 - 4} = \dfrac{75-25+1}{175+10-4} = \dfrac{51}{181} \approx 0.28177, while 3/7≈0.428573/7 \approx 0.42857 — so the terms start noticeably far from the limit, illustrating that convergence is about eventual, not immediate, closeness. At n=100n = 100: a100=30000−500+170000+200−4=2950170196≈0.42026a_{100} = \dfrac{30000 - 500+1}{70000+200-4} = \dfrac{29501}{70196} \approx 0.42026, already close to 0.428570.42857. Verifying convergence via the definition. For n≥1n \ge 1,

∣an−3/7∣=∣−41n+19∣7(7n2+2n−4)≤41n+197(7n2+2n−4)≤60n7⋅7n2=6049n|a_n - 3/7| = \frac{|{-41n+19}|}{7(7n^2+2n-4)} \le \frac{41n + 19}{7(7n^2+2n-4)} \le \frac{60n}{7\cdot 7n^2} = \frac{60}{49n}

for n≥1n\ge1 (using 19≤19n19 \le 19n and 41n+19n=60n41n+19n=60n, and 7n2+2n−4≥7n27n^2+2n-4 \ge 7n^2 for n≥1n \ge 1 since 2n−4≥−2≥2n - 4 \ge -2 \ge well, check directly: at n=1n=1, 2n−4=−22n-4=-2, and 7n2=7>−27n^2 = 7 > -2 trivially satisfied since we only need 7n2+2n−4≥7n2−7n^2+2n-4 \ge 7n^2 - actually simplest: 7n2+2n−4≥7n2−4≥3n2≥3n7n^2+2n-4 \ge 7n^2 - 4 \ge 3n^2 \ge 3n for n≥2n\ge2, and check n=1n=1 directly gives denominator 55; either way the bound 6049n→0\frac{60}{49n}\to 0 suffices for large nn). Given any ε>0\varepsilon > 0, choose NN to be any natural number with N>6049εN > \dfrac{60}{49\varepsilon} (such NN exists by the Archimedean Property of R\mathbb{R}). Then for n≥Nn \ge N,

∣an−3/7∣≤6049n≤6049N<ε.|a_n - 3/7| \le \frac{60}{49n} \le \frac{60}{49N} < \varepsilon.

This confirms an→3/7a_n \to 3/7 in the full ε\varepsilon–NN sense, matching the numerical trend observed above.

Example 2 — a bounded, non-monotone sequence that still converges. Let

bn=(−1)nn+2n+1n+3.b_n = \frac{(-1)^n}{n} + \frac{2n+1}{n+3}.

The first piece oscillates in sign and shrinks; the second piece is a rational function tending to 22. We claim bn→2b_n \to 2. Splitting the estimate. Write

bn−2=(−1)nn+(2n+1n+3−2)=(−1)nn+2n+1−2n−6n+3=(−1)nn−5n+3.b_n - 2 = \frac{(-1)^n}{n} + \left(\frac{2n+1}{n+3} - 2\right) = \frac{(-1)^n}{n} + \frac{2n+1-2n-6}{n+3} = \frac{(-1)^n}{n} - \frac{5}{n+3}.

By the triangle inequality,

∣bn−2∣≤1n+5n+3≤1n+5n=6n.|b_n - 2| \le \frac{1}{n} + \frac{5}{n+3} \le \frac{1}{n} + \frac{5}{n} = \frac{6}{n}.

Numerically: at n=3n = 3, b3=−13+76=−0.3333+1.1667=0.8333b_3 = \dfrac{-1}{3} + \dfrac{7}{6} = -0.3333 + 1.1667 = 0.8333, while at n=4n = 4, b4=14+97=0.25+1.2857=1.5357b_4 = \dfrac{1}{4} + \dfrac{9}{7} = 0.25 + 1.2857 = 1.5357. The sequence is not monotone (it jumped from 0.83330.8333 up to 1.53571.5357), yet both values are consistent with heading toward 22; by n=50n=50, b50=150+10153≈0.02+1.9057=1.9257b_{50} = \dfrac{1}{50} + \dfrac{101}{53} \approx 0.02 + 1.9057 = 1.9257, closer still. Verifying via the definition. Given ε>0\varepsilon > 0, choose N∈NN \in \mathbb{N} with N>6/εN > 6/\varepsilon (again by the Archimedean property). For n≥Nn \ge N,

∣bn−2∣≤6n≤6N<ε.|b_n - 2| \le \frac{6}{n} \le \frac{6}{N} < \varepsilon.

Hence bn→2b_n \to 2. This example shows convergence does not require the sequence to approach its limit monotonically from one side — oscillation is allowed, provided the size of the oscillation shrinks to zero.

CounterexampleDropping "for a single fixed LL" collapses uniqueness

The Uniqueness Theorem assumed that L1L_1 and L2L_2 are each fixed real numbers satisfying the convergence condition for the same sequence. If instead we sloppily allowed the "tolerance window" to be centered at a moving target — that is, if we let the candidate limit depend on nn — the entire argument breaks, and uniqueness (and the very notion of a limit) becomes meaningless. Concretely, consider the sequence an=na_n = n paired with the "moving target" Ln=nL_n = n. Trivially ∣an−Ln∣=0<ε|a_n - L_n| = 0 < \varepsilon for every nn and every ε>0\varepsilon > 0 — the inequality in the definition of convergence is satisfied term by term. But this says nothing about (an)(a_n) converging to anything fixed: (n)(n) is in fact unbounded and divergent. If we permitted the target in the definition to vary with nn, we could "prove" that every sequence converges (to itself), destroying the content of the definition and, with it, the proof of uniqueness, which crucially used that N1N_1 and N2N_2 were chosen relative to the same fixed L1,L2L_1, L_2 so that a single index N=max⁡(N1,N2)N=\max(N_1,N_2) could pit them against each other via the triangle inequality. This shows precisely why the definition insists on a single fixed real number LL as the target: it is the fixedness of LL, not merely the smallness of ∣an−(something)∣|a_n - (\text{something})|, that gives convergence its content and makes the Uniqueness Theorem provable at all.

Scope, edge cases & common traps

SituationWhat to watch for
Sequence with a finite number of "bad" early termsConvergence only concerns the tail; any finite set of initial terms may be altered without affecting convergence or the limit.
Oscillating sign, e.g. (−1)n/n(-1)^n/nStill converges (to 00) as long as the size of oscillation shrinks to 00; do not confuse "not monotone" with "not convergent."
Bounded but not convergent, e.g. (−1)n(-1)^nBoundedness alone never implies convergence; it is a necessary, not sufficient, condition (converse direction fails).
Quantifier order in the definitionε\varepsilon must be chosen first (arbitrarily, by an adversary), and NN found afterward, possibly depending on ε\varepsilon.
Sequences of rationals converging to an irrational limitPerfectly legitimate — e.g. decimal truncations of 2\sqrt2 — since LL ranges over R\mathbb{R}, not just over the values the sequence itself takes.

The mathematician behind it

Origins · 1 minAugustin-Louis Cauchy and how this was discovered
AC
Augustin-Louis Cauchy
1789–1857 · Early 19th-century French analysis, École Polytechnique

Cauchy was among the first to insist that calculus be built on precise inequalities rather than infinitesimal intuition alone, laying groundwork that led directly to the ε\varepsilon–NN formulation of limits used throughout modern analysis. His Cours d'Analyse (1821) systematically treated limits, continuity, and convergence of sequences and series with a rigor that was new for its time, and the notion now called a "Cauchy sequence" — a sequence whose terms become arbitrarily close to each other, not just to a fixed limit — bears his name.

History
- 1821 — Cauchy publishes the Cours d'Analyse, treating limits and convergence with unprecedented rigor for sequences and series.
- 1817 — Bernard Bolzano gives an early rigorous treatment of continuity and convergence, largely unrecognized in his lifetime.
- 1854–1872 — Karl Weierstrass, lecturing at Berlin, refines the modern ε\varepsilon–δ\delta (and ε\varepsilon–NN) formalism into the form used today.
- 1872 — Georg Cantor and Richard Dedekind independently construct the real numbers rigorously, supplying the completeness that limit arguments ultimately rest on.
- 1900s onward — The ε\varepsilon–NN definition of sequence convergence becomes the standard opening topic of real analysis curricula worldwide.
Is a sequence the same thing as a set of numbers?

No. A sequence is a function from N\mathbb{N} to R\mathbb{R}, so it carries an order and can repeat values, whereas a set has no order and no repetition. For example, the sequence an=(−1)na_n = (-1)^n takes only the two values 11 and −1-1, but as a sequence it is the infinite ordered list −1,1,−1,1,…-1, 1, -1, 1, \ldots, which is very different information from the two-element set {−1,1}\{-1, 1\}. This distinction matters because convergence is fundamentally about the behavior of the indexing, i.e. what happens as nn grows, not merely about which values appear.

Can a sequence converge to more than one limit?

No — this is exactly the content of the Uniqueness Theorem proved above. If a sequence converged to two different real numbers L1≠L2L_1 \ne L_2, then by choosing the tolerance ε=∣L1−L2∣/2\varepsilon = |L_1-L_2|/2 we could force a single term to lie within ε\varepsilon of both L1L_1 and L2L_2 simultaneously, and the triangle inequality then produces the impossible statement ∣L1−L2∣<∣L1−L2∣|L_1-L_2| < |L_1-L_2|. So the limit, when it exists, is unique, and the notation lim⁡n→∞an\lim_{n\to\infty} a_n is unambiguous.

Does convergence care about the first million terms of the sequence?

No, not for whether the limit exists or what its value is. Convergence is entirely a statement about the tail of the sequence: for any tolerance, only finitely many early terms are allowed to lie outside the window, and altering or deleting any finite number of initial terms cannot change whether the sequence converges or what it converges to. It can, however, change the specific index NN required for a given tolerance, since NN must be found after accounting for however the early terms behave.

Why must ε\varepsilon be chosen before NN, and not the reverse?

Because the entire content of "getting arbitrarily close" is that the sequence must accommodate every possible level of precision, however demanding. Choosing NN first would fix a single stopping point in advance, and then requiring it to work for all ε\varepsilon — including impossibly small ones — would force the terms to equal LL exactly past that point, which is far too strong and essentially never true for interesting sequences. The correct order lets the required index NN depend on, and grow with, the shrinking tolerance ε\varepsilon.

Is every bounded sequence convergent?

No. Boundedness is necessary but not sufficient for convergence, as shown by an=(−1)na_n = (-1)^n, which is bounded between −1-1 and 11 but oscillates forever without settling near any single value. (It is worth noting, as a preview of later results, that the Bolzano–Weierstrass theorem guarantees a bounded sequence always has a convergent subsequence, even when the full sequence itself diverges — but that is a separate and stronger statement than convergence of the original sequence.)

How does this relate to continuity and to Cauchy sequences?

Sequence convergence is the atomic building block underneath continuity: a function ff is continuous at aa precisely when an→aa_n \to a implies f(an)→f(a)f(a_n) \to f(a) for every sequence (an)(a_n). A related but logically independent notion is a Cauchy sequence, where terms become arbitrarily close to each other (not to a pre-specified limit); in R\mathbb{R}, thanks to completeness, every Cauchy sequence turns out to converge, but this equivalence is itself a theorem to be proved separately, not a restatement of the definition given here.

Why do we insist LL be a real number rather than, say, allowing L=∞L=\infty?

By convention, "convergence" in the sense defined here is reserved for a finite real limit, because the ε\varepsilon–NN definition literally measures distance ∣an−L∣|a_n - L|, which requires LL to be a genuine point on the real line. Sequences like an=na_n = n, which grow without bound, are said to diverge to infinity, a related but formally distinct notion (defined by a different quantified statement: for every MM there is an NN such that an>Ma_n > M for n≥Nn \ge N) rather than convergence in the strict sense used here.

Where this leads