Mobile app version of vmapp.org
Login or Join
Speyer207

: What is a confidence threshold of 95,0% in Google Analytics Experiments? In Google Analytics Experiments you can Set a confidence threshold 95.0% (or 99,0% or 99,5%). The documentation says:

@Speyer207

Posted in: #ABTesting #GoogleAnalytics

In Google Analytics Experiments you can Set a confidence threshold
95.0% (or 99,0% or 99,5%). The documentation says:


Set a confidence threshold: The minimum confidence threshold that must be achieved before Analytics can declare a winner. The higher the threshold, the more confident you can be in the result. A higher threshold can result in Analytics taking longer to declare a winner.


I understand the words but I have no clue what that means. What is a confidence treshold of 95%?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Speyer207

1 Comments

Sorted by latest first Latest Oldest Best

 

@Annie201

Confidence threshold (or level) is a statistical term which, in a nut shell, denotes the confidence with which you can say that experiment A is better than experiment B.

It denotes the statistical significance with which you can declare the winner. You can read more about it here - www.stat.yale.edu/Courses/1997-98/101/meancomp.htm
To reach higher confidence level, you need more data and thus google will need more time to reach 99.0% level than it require to reach 90% confidence level and thus they ask this number so they can declare winner when they achieve this confidence level.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme