News for hackers. Stuff that matters.
Re:Do bigger images mean improved conversion rates? Three ca... by robomartin on Monday April 01, 2013 @09:43AM (#5472933)
How would you calculate what would constitute statistically significant results for each of these sites? How about any other site?
Re:Do bigger images mean improved conversion rates? Three ca... by saurik on Monday April 01, 2013 @10:00AM (#5473033)
It doesn't really have anything to do with the site... it has to do with what the difference is vs. the total size of the sample. If you see a 50% increase but only had 3 people in your sample, that is not statistically significant because the probability of that happening by chance is so high. To make this concrete, if the actual proportion was 4:1 against that figure (as in, you "should" have measured a whopping decrease to 25% the original conversion), you'd still measure the totally incorrect 50% increase in one out of every ten attempts at that measurement.
Re:Do bigger images mean improved conversion rates? Three ca... by robomartin on Tuesday April 02, 2013 @11:41AM (#5479964)
I failed to make the point of my question clear enough. Nickpotier critiqued the results without offering up any numbers. I wanted to see what he thought the numbers should have been for each example given.
Re:Do bigger images mean improved conversion rates? Three ca... by jmount on Monday April 01, 2013 @10:12AM (#5473099)
Roughly a good sample size is around -log(d/2)/(2 e a^2) where d is the significance you want and a is the difference in conversion rates you hope to measure. See http://www.win-vector.com/blog/2013/03/a-bit-more-on-sample-...
Re:Do bigger images mean improved conversion rates? Three ca... by Sprint on Monday April 01, 2013 @02:58PM (#5475120)
I read that and I have no idea what those values are. Is there an example of this with actual real-life data?
Re:Do bigger images mean improved conversion rates? Three ca... by russell on Monday April 01, 2013 @06:03PM (#5476252)
He gave you a reference. Google "statistical sample size". There are several calculators in the results that you can play around.

Everybody should take a college level course in statistics, even poets and painters.