A/B Test Statistical Tools
Test Data
Control (A)
Variant (B)
Results
Enter your test data above to see results
This calculator assumes: No peeking at results before the test is complete, and proper test planning (sample size determined in advance). Violating these assumptions inflates false positive rates. Use the Test Planning tab to calculate required sample sizes before running your test.
Methodology
Sources: Georgiev, G. "Statistical Methods in Online A/B Testing" (Analytics-Toolkit.com, 2019). Mayo, D.G. "Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars" (2018). Microsoft Research, "A/B Interactions: A Call to Relax" (2019).