News for hackers. Stuff that matters.
Re:The multiple comparisons problem by btilly on Wednesday January 07, 2015 @02:06PM (#8852536)
I'm coming to the conclusion that one should treat A/B testing from more of an economic point-of-view. You have so many views this month -- how are you going to spend them on tests?

I'm curious, did our conversations a few years ago help shape this opinion? My guess is that we've both moved somewhat towards a middle position.

Re:The multiple comparisons problem by noelwelsh on Thursday January 08, 2015 @08:49AM (#8856324)
Yes, I think so.

It might be of interest to you that there is now some published work on bandit algorithms for when all you have is ranking, not absolute ordering. This is close to what we were talking about: http://arxiv.org/pdf/1312.3393.pdf