Experiments. how long do they take?

Forum Moderators: martinibuster

Message Too Old, No Replies

Experiments. how long do they take?

csdude55

8:01 am on Apr 12, 2016 (gmt 0)

I implemented 2 experiments to begin on 4/9/16, but both still say "collecting data" and have a confidence of 50%.

From 4/9 until 4/11 Adsense shows 324,524 pageviews and 1,012,683 ad impressions. How long does it usually take before the confidence level changes?

LuckyD

3:43 pm on Apr 13, 2016 (gmt 0)

For me it's usually around 0.5-1 million impressions for a given ad unit. If the delta is very small, then you'll probably need even more data.

csdude55

8:51 am on Apr 16, 2016 (gmt 0)

Just for posterity, the experiments ran for 7 days and had 2.5 million impressions, but one was still at 50% and the other at 52%. I gave up and just stopped them both.

Swanny007

1:06 am on Apr 17, 2016 (gmt 0)

The last few times I let the experiments run for months with millions of impressions and the confidence level never got near the 95% they recommend before picking a "winner". I just started another experiment two days ago so I'll try it again LOL.