Mobile app version of vmapp.org
Login or Join
Cody1181609

: If you run a split test, how long do you let it run before you conclude it is inconclusive? When running A/B tests with Google Website Optimizer, Google tells you when a variation has "won".

@Cody1181609

Posted in: #ABTesting #GoogleWebsiteOptimizer

When running A/B tests with Google Website Optimizer, Google tells you when a variation has "won". However, sometimes, the test runs for a long time and still there is no winner.

When should one decide that there is no significant difference between two variations and stop the test?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Cody1181609

1 Comments

Sorted by latest first Latest Oldest Best

 

@Bryan171

The Visual Website Optimizer blog has an A/B test duration calculator designed to answer your question. It's published as an Excel spreadsheet, but don't let that put you off.

Enter your original conversion rate, the difference you're hoping to detect, the number of variations you're testing, and your average daily traffic, and it spits out the number of days you should wait before stopping the test.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme