News for hackers. Stuff that matters.
Re:Ask HN: What are the cons of experimentation driven produ... by bombcar on Monday October 31, 2022 @10:41PM (#33416289)
If you do A/B testing wrong it can be bad (search around that and you’ll find stuff)

If you maximize signups you may be fishing with too large a net and catch customers who aren’t appropriate. A/B won’t tell you that.

You may end up at a local maxima optimizing things when you should be fixing major real issues.

Experimentation should have a hypothesis and a test, not throwing stuff at the wall to see what sticks.

There are no comments on this comment yet.