Data Science Intermediate Pro

A/B Testing & Online Experimentation

Design, size, run and read online experiments that product decisions can actually rest on

30 min read 37 views

Learn to design trustworthy online experiments: pick metrics and randomisation units, size a test with power and MDE, catch SRM and peeking, cut variance with CUPED, and read lifts, segments and holdouts correctly.

Part of the Data Science Foundations path → Part of the Reinforcement Learning & Long-term Optimization path →

Preview Subscribe to unlock

Practice questions (6)

Sizing a Checkout Experiment

Intermediate · Free

View →
Diagnosing a Sample-Ratio Mismatch

Intermediate

View →
Choosing the Randomisation Unit in a Marketplace

Advanced

View →
Cutting Sample Size with CUPED

Advanced

View →
Metric Moved but Not Significant, and a Winning Segment

Intermediate

View →

See all 6 questions →

Quizzes (1)

A/B Testing & Online Experimentation Quiz

0 attempts · 10 min · Pass 70% · Intermediate

Take quiz →