This module explains sampling distributions, null and alternative hypotheses, p-values, Type I and Type II errors, statistical power, confidence intervals and effect sizes. These concepts are the foundation of every test in the course and are among the most frequently misreported ideas in doctoral theses.
Free previewLesson 1 · From sample to population: sampling distributions and standard errorPreview video to be added
Watch the first lesson of every module free. The remaining lessons, exercises and live sessions open when you enrol.
What you will be able to do
State null and alternative hypotheses and choose one-tailed or two-tailed tests with justification
Interpret a p-value correctly as the probability of data at least as extreme as observed if the null hypothesis were true
Explain Type I and Type II error, alpha and power, and run an a priori power analysis
Report and interpret confidence intervals and effect sizes alongside p-values
Key terms
Null hypothesis
p-value
Type I error
Type II error
Statistical power
Confidence interval
Effect size
Standard error
Hands-on practice
Run an a priori power analysis in G*Power for a planned two-group comparison and write a two-sentence sample size justification.
Common pitfalls this module fixes
Interpreting p > .05 as evidence that there is no effect; a non-significant result means the data are compatible with a range of effects, so report the confidence interval.
Treating the p-value as the probability that the null hypothesis is true; it is a probability about the data given the null.
Running post hoc 'observed power' after a non-significant result; it adds nothing beyond the p-value, so plan power before data collection.