Back to Tags

#ab testing

A/B Test Plan — Hypothesis, Sample Size and Stop Rules

Plan an A/B test before you run it: the hypothesis, primary and guardrail metrics, a sample size estimate from your baseline and traffic, duration and the rules for calling it.

Nigel Yoshida

Experiment Readout — What We Learned and What We'll Do

Write up an experiment's results honestly: what you tested, the numbers, whether the result is trustworthy, what you learned and the decision, including when the answer is no difference.

Nigel Yoshida