Logo
ABTestResult.com
The ultimate A/B test calculator

Welcome

This web app hosts a set of calculators designed for precise test analysis, sample sizing, and utility calculations. It provides a straightforward user interface and approach to understanding statistical significance, confidence intervals, and addressing sample ratio mismatches. Whether it is a T-Test or a Z-Test, a one-tailed or a two-tailed test, a non-inferiority or paired (pre-post) test, you can use this tool to understand the results of your experiment.In the Sample Sizing section, you can customize your pre-test analysis by adjusting power, confidence levels, managing multiple variations and test setups. The Utilities section provides tools for calculating standard deviation, checking normality of test data, and resolving sample ratio mismatches. For a deeper understanding of A/B testing theory, the resources section contains curated readings from authoritative sources.

Sections

Whether you're here to learn, do pre-test analysis or post-test analysis, the cards below link to the most relevant page.
test analysis
Test Analysis
Use the power of statistics to analyse your a/b test. In a few clicks, you'll be able to find out about statistical significance, confidence intervals, sample ratio mismatch and much more...
sample sizing
Sample Sizing
Pre-test analysis: find out how many samples you need to run your experiment. It allows for different power and confidence levels, multiple variations (with Šidák correction) and multiple test setups.
utilities
Utilities
In this section you'll find a few useful standalone calculators: standard deviation from group of observations, normality checker for test data, sample ratio mismatch...
resources
Resources
Interested to know more about the theory behind a/b testing? Here you can find interesting reads from some of the most authoritative sources and documentation to upskill yourself on this topic.