AB Test Calculator

AB Test Calculator calculator can be used to determine the statistical significance of an AB test based on conversion rates.

Input Parameters

Calculation Results

Calculation Formula

The statistical significance is calculated using a two-proportion z-test.

Where:
p1 = control group conversion rate
p2 = variant group conversion rate
n1 = control group visitors
n2 = variant group visitors
z = calculated z-score
p = pooled conversion rate (p1 + p2) / 2

AB Test Calculator Calculator Usage Guide

Learn how to use the AB Test Calculator calculator and its working principles

How to Use the AB Test Calculator

  1. Enter the number of visitors and conversions for the control group in the respective fields.
  2. Enter the number of visitors and conversions for the variant group in the respective fields.
  3. Click the "Calculate" button to compute the conversion rates, z-score, and p-value.
  4. If the p-value is less than 0.05, it indicates a statistically significant difference between the control and variant groups.

Understanding the Results

The calculator provides the following results:

  • Control Group Conversion Rate: The percentage of control group visitors who converted.
  • Variant Group Conversion Rate: The percentage of variant group visitors who converted.
  • Z-Score: A measure of how many standard deviations the conversion rates differ from each other.
  • P-Value: The probability of observing a difference as extreme as the one calculated, assuming there is no actual difference between the groups.