Re:Optimization at the Obama campaign: a/b testing
by irahul on Wednesday December 12, 2012 @11:00AM
(#4910684)
> Not all optimizations are universal.
One example from the top of my mind would be Wikipedia's "personal appeal from Jimmy Wales" campaign. That photo made me uncomfortable, and I would have liked a more panoramic shot with the subject in focus like the one used for "Dinner with Obama". But Jimmy Wales responded to someone(I can't find the thread; was on reddit I think) that it converted better than other alternatives.
That said, starting with some known best practice(long forms, make it multi step) and then measuring the alternatives goes a long way.
Re:Optimization at the Obama campaign: a/b testing
by patio11 on Wednesday December 12, 2012 @11:58AM
(#4911118)
Wiki published all the numbers from that campaign. The personal appeal from Jimmy creative absolutely ROFLstomped everything else they came up with. 10X improvements, literally.
Here's the raw data.
http://meta.wikimedia.org/wiki/Fundraising_2010/Banner_testi...
Pro tip: Don't just copy what Obama did. Your mileage will vary based on your user base and context. Take their learnings and A/B test it on your own site to see if it works for you or not. Not all optimizations are universal.