Academic Statistics · Module 02 of 11

Inferential statistics and hypothesis testing

This module explains sampling distributions, null and alternative hypotheses, p-values, Type I and Type II errors, statistical power, confidence intervals and effect sizes. These concepts are the foundation of every test in the course and are among the most frequently misreported ideas in doctoral theses.

Watch the first lesson of every module free. The remaining lessons, exercises and live sessions open when you enrol.

What you will be able to do

  • State null and alternative hypotheses and choose one-tailed or two-tailed tests with justification
  • Interpret a p-value correctly as the probability of data at least as extreme as observed if the null hypothesis were true
  • Explain Type I and Type II error, alpha and power, and run an a priori power analysis
  • Report and interpret confidence intervals and effect sizes alongside p-values

Key terms

  • Null hypothesis
  • p-value
  • Type I error
  • Type II error
  • Statistical power
  • Confidence interval
  • Effect size
  • Standard error

Hands-on practice

Run an a priori power analysis in G*Power for a planned two-group comparison and write a two-sentence sample size justification.

Common pitfalls this module fixes

  • Interpreting p > .05 as evidence that there is no effect; a non-significant result means the data are compatible with a range of effects, so report the confidence interval.
  • Treating the p-value as the probability that the null hypothesis is true; it is a probability about the data given the null.
  • Running post hoc 'observed power' after a non-significant result; it adds nothing beyond the p-value, so plan power before data collection.