Statistical Significance and Minimum Conversions

Set the Confidence Interval for the Results

There are several options for adjusting the statistical evaluations of the experiments to your needs.

Setting the Statistical Significance (Confidence Level)

In statistics, the confidence level indicates the probability, with which the estimation of the location of a statistical parameter (e.g. an arithmetic mean) in a sample survey is also true for the population.

It is possible to set a value between 50% and 99.9%.

  • Choose a low value if you need fast results
  • Choose a high value if you need a statistically most reliable result

See here for more details:
https://www.statista.com/statistics-glossary/definition/328/confidence_level/

Minimum Conversions

To prevent a winner from being determined too soon after the start of an experiment, a minimum number of conversions should be set.
Meaningful values can be 100 or 1000, for example.