News for hackers. Stuff that matters.
Re:Dutch national broadcaster saw ad revenue rise when it st... by cortesoft on Monday July 06, 2020 @12:00PM (#23749251)
Yeah, I often wonder this... a/b tests only ever measure short term differences. What if the change you are making increased sales for a few months, but pisses off users in the long run?

An A/B test isn't going to show that.

Re:Dutch national broadcaster saw ad revenue rise when it st... by shostack on Tuesday July 07, 2020 @07:31PM (#23765445)
A regression model might if you have sufficient data.
Re:Dutch national broadcaster saw ad revenue rise when it st... by cortesoft on Tuesday July 07, 2020 @10:09PM (#23766268)
You would have to run the a/b test for quite a while, and I don't think many companies do.