News for hackers. Stuff that matters.
Re:Most Winning A/B Test Results are Illusory [pdf] by beambot on Sunday February 23, 2014 @07:23PM (#7288410)
Related... someone should write a good article about estimating customer acquisition costs (CAC, or ROI if you prefer) based on conversion rates of ads.

It drives me batty when people tell me their "average" conversion rate is 1% after running a $25 ad campaign with so few clicks. It seems like too many folks are just oblivious to sample size, confidence interval, and power calculations -- something that could be solved with a quick Wikipedia search [1].

[1] https://en.wikipedia.org/wiki/Sample_size_determination

There are no comments on this comment yet.