Introduction to Statistics

Statistics is the science of collecting, organizing, analyzing, interpreting, and presenting data. Every time a government tracks unemployment rates, a doctor compares treatment outcomes, or a sports analyst evaluates player performance, statistics is the engine driving those decisions. At its core, statistics gives us a principled way to move from raw, messy information to reliable conclusions about the world. Data alone tells us very little. A list of 10,000 exam scores is overwhelming until we summarize it: What is the average? How spread out are the scores? Are they clustered near one value or spread evenly? Statistics provides the vocabulary and tools—means, medians, standard deviations, distributions, and more—to answer exactly these kinds of questions efficiently and honestly. There are two major branches of statistics. Descriptive statistics summarizes and describes the data you actually have, using numbers and graphs. Inferential statistics uses a smaller sample to draw conclusions about a larger population. Both branches rely on a careful understanding of what type of data you are working with and what kind of question you are trying to answer.

Key takeaways
  • Populations and Samples
  • Types of Variables
  • Types of Statistical Questions
  • Levels of Measurement
  • Descriptive vs. Inferential Statistics

Populations and Samples

A population is the entire group of individuals or items you want to study—for example, all 16-year-olds in a country. Because studying every member of a large population is often impossible or too expensive, statisticians study a sample, which is a carefully chosen subset. The goal is always that the sample accurately represents the population so that conclusions can be generalized. A parameter is a numerical fact about a population (e.g., the true average height of all 16-year-olds), while a statistic is the corresponding value calculated from a sample (e.g., the average height of 200 surveyed students). The Greek letter μ (mu) often denotes a population mean and x̄ (x-bar) denotes a sample mean.

Types of Variables

A variable is any characteristic that can take different values across individuals. Variables fall into two broad categories. Categorical (qualitative) variables place individuals into groups or categories, such as favorite subject (Math, Science, History) or blood type (A, B, AB, O). Numerical (quantitative) variables take meaningful number values. These are further divided into discrete variables, which take countable values (number of siblings: 0, 1, 2, …), and continuous variables, which can take any value in an interval (height: 1.72 m, 1.724 m, etc.). Understanding variable type determines which statistical tools are appropriate.

Types of Statistical Questions

Not every question involving numbers is a statistical question. A statistical question is one that anticipates variability in the data collected to answer it. For example, 'How tall is my friend Marco?' has a single definite answer—not statistical. But 'How tall are students in my school?' anticipates that heights vary, making it statistical. Statistics can answer four broad types of questions: (1) Description—What does the data look like? (2) Comparison—Is group A different from group B? (3) Relationship—Does one variable predict another? (4) Generalization—Can we extend these findings to a larger population?

Levels of Measurement

Data can also be classified by its level of measurement, which determines what mathematical operations are valid. Nominal data: categories with no order (colors, nationalities). Ordinal data: categories with a meaningful order but unknown gaps between them (survey ratings: poor, fair, good, excellent). Interval data: ordered values with equal spacing but no true zero (temperature in °C—0°C does not mean 'no temperature'). Ratio data: ordered, equally spaced, with a true zero (height, mass, time). Only with ratio and interval data can we meaningfully compute averages; only with ratio data can we say one value is 'twice as large' as another.

Descriptive vs. Inferential Statistics

Descriptive statistics includes tools such as frequency tables, histograms, the mean, median, mode, and standard deviation. These summarize the sample data itself—nothing more. Inferential statistics uses probability theory to draw conclusions beyond the data. If 55 out of 100 randomly sampled students prefer online learning, a descriptive statement is: '55% of our sample prefers online learning.' An inferential statement is: 'We estimate that between 45% and 65% of all students in the school prefer online learning (with 95% confidence).' The inferential step requires rigorous probabilistic reasoning and careful sampling methods.

The Key Equation

xˉ=1n∑i=1nxi=x1+x2+⋯+xnn\bar{x} = \frac{1}{n}\sum_{i=1}^{n} x_i = \frac{x_1 + x_2 + \cdots + x_n}{n}
  • \bar{x} — Sample mean (same as data): The arithmetic average of all values in the sample; a key descriptive statistic.
  • n — Sample size (count (dimensionless)): The number of observations (data points) in the sample.
  • x_i — Individual data value (same as data): The i-th observation in the dataset, where i ranges from 1 to n.
  • \sum_{i=1}^{n} — Summation operator (—): Instructs us to add all values of x_i as i goes from 1 to n.

Worked Example

Problem. A teacher records the number of hours 8 students spent studying for an exam: 3, 5, 2, 7, 4, 6, 5, 4. (a) Identify the variable type. (b) Calculate the sample mean. (c) Identify whether this is an example of descriptive or inferential statistics.

xˉ=368=4.5 hours\bar{x} = \frac{36}{8} = 4.5 \text{ hours}

Answer. The variable is continuous and ratio-scaled. The sample mean study time is 4.5 hours. Reporting this value for the 8 students is descriptive statistics.

Figure
Diagram
The Statistical Process: From Question to Conclusion1. Ask a StatisticalQuestion2. Collect Data(Sample from Population)3. Analyze Data(Descriptive Statistics)4. Interpret Results(Inferential Statistics)5. Draw ConclusionsPopulationAll individualsof interestSampleSubset actuallymeasured
Origins · 1 minFlorence Nightingale and how this was discovered
FN
Florence Nightingale
1820–1910 · British

Florence Nightingale is best known as a pioneering nurse, but she was also a brilliant statistician. During the Crimean War (1853–1856), she collected systematic data on soldiers' deaths and discovered that far more soldiers were dying from preventable infections than from battle wounds. She invented the 'polar area diagram' (sometimes called a coxcomb chart), a form of circular histogram, to display this data visually and compel government officials—who were not mathematically trained—to take action. Her work directly led to sanitary reforms that saved thousands of lives and established statistical graphics as a tool for persuasion and public policy. Nightingale applied to study mathematics at age 17, but her parents refused because it was considered inappropriate for a woman of her social class. She taught herself anyway, studying for hours each morning before the rest of the household awoke.

  • Measures of Central Tendency — Mean, median, and mode are the primary descriptive tools introduced once you understand what statistics is and what types of data exist.
  • Measures of Spread — Range, variance, and standard deviation describe variability in data—the next essential layer of descriptive statistics after central tendency.
  • Sampling Methods — Understanding how samples are chosen (random, stratified, systematic) is critical for deciding when inferential conclusions are valid.
  • Data Representation and Graphs — Histograms, bar charts, and dot plots are essential tools for the data exploration phase of the statistical process.
  • Introduction to Probability — Probability is the mathematical foundation that makes inferential statistics possible—without it, we cannot quantify uncertainty in our conclusions.