News for hackers. Stuff that matters.
Re:Optimization at the Obama campaign: a/b testing by pdog on Wednesday December 12, 2012 @11:03AM (#4910698)
> Overall we executed about 500 a/b tests on our web pages in a 20 month period which increased donation conversions by 49% and sign up conversions by 161%.

How did they measure this? Did they isolate the effects of the a/b testing? Donation and sign up conversion rates will increase anyways as the day of the election approaches.

Re:Optimization at the Obama campaign: a/b testing by karolisd on Wednesday December 12, 2012 @11:06AM (#4910725)
You're always testing against a control and have something to compare to.

If they really wanted to, they could've kept a small amount of traffic going to the original control from before they started testing.