News for hackers. Stuff that matters.
Re:Why small tweaks and split testing don't work, and what t... by hn_throwaway_99 on Thursday November 29, 2018 @08:39PM (#18565873)
Except that Booking actually has data to back this all up. It's very common to do "holdbacks" so that you, say, give an old version of your website to a very small portion of your user's, then compare its conversion rate to a version of your site that has all the latest A/B test winners. Booking also tracks religiously how conversion rates change over time.

The whole point being that the way Booking (and other) companies act is the exact opposite of a cargo cult. Everything needs to be backed up with data and challenging conclusions is part of the culture.

All that said, a common complaint of Booking is that it has a ton of "dark UI" patterns, so it will be interesting if there is any long term blowback against short term A/B winners that erode the goodwill to the brand over time.

There are no comments on this comment yet.