Statistical Significance and Minimum Conversions
Set the Confidence Interval for the Results
There are several options for adjusting the statistical evaluations of the experiments to your needs.
Setting the Statistical Significance (Confidence Level)
In statistics, the confidence level indicates the probability, with which the estimation of the location of a statistical parameter (e.g. an arithmetic mean) in a sample survey is also true for the population.
It is possible to set a value between 50% and 99.9%.
- Choose a low value if you need fast results
- Choose a high value if you need a statistically most reliable result
See here for more details:
https://www.statista.com/statistics-glossary/definition/328/confidence_level/
Minimum Conversions
To prevent a winner from being determined too soon after the start of an experiment, a minimum number of conversions should be set.
Meaningful values can be 100 or 1000, for example.