: A/B testing problem Optimizely and Google Analytics with Screen Resolution=(not set) We've setup an A/B in Optimizely to test a completely new design: http://offerta.se that we're testing against

@Smith883

According to the following article "Screen Resolution=(not set)" means that there was no information regarding the visitor's screen resolution saved: support.google.com/analytics/answer/2820717?hl=en
Looking at your data for all aggregated visitors, or removing the visitors from which the screen resolution is unknown, is basically looking at different segments of your data.

It can be that visitors with different screen resolutions react differently to your designs. So including or excluding screen resolutions (or visitors from which no screen resolution is known) can have a different result.

If you would like optimize your website for overall traffic you should look at the aggregated result.

To further elaborate: (from Google Support)


It is quite common that the screen resolution that has the highest Ecommerce conversion rate is (not set). Additionally, a high incidence of (not set) Ecommerce rates can occur for these dimensions:


Flash Version (occurs if Flash is disabled in browser settings)
Screen Colors
Language (in demographics report)
Generally, these traffic segments are small, and so are not statistically significant.


and

Browser and Screen Resolution


Use Browser or Screen Resolution as the dimension so you can see whether traffic is distributed among browsers or screen resolutions as you expect, and to see whether there are any pages that experience an unusual drop-off with a particular browser or screen resolution. If you notice a significant drop-off from a page, it might not be rendering properly in that browser or at that resolution. For example, your page may not render correctly on a mobile browser or at a smaller resolution, causing links or buttons to be unavailable or not easily seen."


Also, your results are correctly showing 50/50 allocated results on your two variants (and their target) offerta.se/google and the redirect: offerta.se/google?classic=1. The GA report through the screen resolution=(not set) string is showing you segmented data that Optimizely has no affect over.

Vote Up Vote Down