A/B Testing & Online Experimentation

Design, size, run and read online experiments that product decisions can actually rest on

Learn to design trustworthy online experiments: pick metrics and randomisation units, size a test with power and MDE, catch SRM and peeking, cut variance with CUPED, and read lifts, segments and holdouts correctly.

Practice questions (5)

• Sizing a Checkout Experiment

  Intermediate · Free
  View →

• Diagnosing a Sample-Ratio Mismatch

  Intermediate
  View →

• Choosing the Randomisation Unit in a Marketplace

  Advanced
  View →

• Cutting Sample Size with CUPED

  Advanced
  View →

• Metric Moved but Not Significant, and a Winning Segment

  Intermediate
  View →

Quizzes (1)