6.5 Hypothesis Tests


2026 Syllabus Objectives

By the end of this topic, you should be able to:

  1. Understand the nature of a hypothesis test, the difference between one-tailed and two-tailed tests, and the terms: null hypothesis, alternative hypothesis, significance level, rejection region (critical region), acceptance region, and test statistic. You should also be able to interpret results in context.
  2. Formulate hypotheses and carry out a hypothesis test for a single observation from a binomial or Poisson distribution, using direct evaluation of probabilities or a normal approximation where appropriate.
  3. Formulate hypotheses and carry out a hypothesis test for a population mean when the population is normally distributed with known variance, or when a large sample is used.
  4. Understand the terms Type I error and Type II error.
  5. Calculate the probabilities of making Type I and Type II errors in situations involving normal distributions or binomial/Poisson probabilities.

1. What Is a Hypothesis Test?

A hypothesis test is a formal statistical method for deciding whether there is enough evidence in a sample to support a particular claim about a population. Think of it like a courtroom: you start by assuming the person is innocent (no change, no effect), and you only change your mind if the evidence is strong enough.

The Five Steps of a Hypothesis Test

  1. Set up the null and alternative hypotheses.
  2. Choose a significance level.
  3. Collect data using a random sampling method (data must be independent).
  4. Carry out the test — do the calculations.
  5. Interpret the result in the context of the original problem.

2. Key Terms Explained

Null Hypothesis (H₀)

The null hypothesis is the starting assumption — the "nothing has changed" position. It always contains an equals sign. You assume H₀ is true unless the data gives you enough evidence to reject it.

Example: H₀: p = 0.5 (the probability of getting heads is 0.5 — the coin is fair)

Alternative Hypothesis (H₁)

The alternative hypothesis is the claim you are trying to find evidence for. It represents the idea that something has changed or that a specific effect exists.

Example: H₁: p > 0.5 (the coin is biased towards heads)

Test Statistic

The test statistic is the value you calculate from your sample data. You use it to decide whether to reject H₀. For example, it might be the number of heads in 20 coin tosses, or the sample mean from a group of measurements.

Significance Level

The significance level (written as α, pronounced "alpha") is the probability threshold you set before the test. It is the maximum probability of wrongly rejecting H₀ that you are willing to accept. Common values are 5% (0.05), 1% (0.01), and 10% (0.10).

  • A small significance level (e.g., 1%) means you need very strong evidence before rejecting H₀.
  • A larger significance level (e.g., 10%) makes it easier to reject H₀, but you risk being wrong more often.

Rejection Region (Critical Region)

The rejection region (also called the critical region) is the set of values of the test statistic for which you would reject H₀. If your observed value falls in this region, you reject the null hypothesis.

Acceptance Region

The acceptance region is the set of values for which you do not reject H₀. If the test statistic falls here, there is not enough evidence to reject H₀.

Sign in to view full notes