News for hackers. Stuff that matters.
Re:Why designers don’t like A/B testing by wpietri on Monday August 08, 2011 @05:50AM (#2859418)
It seems like this person's answer boils down to "because sometimes other people use it wrongly," which strikes me as weak. Sure, it's true; he catalogs a few ways the clueless can misuse A/B tests. But you can over-weight any evaluative result. Including (cough, cough) a designer's own opinion of their work.

He's wrong on one point, though: some designers definitely hate A/B testing because they don't like being proved wrong.

A fair number of designers apply a genius-beyond-fathoming approach to presenting designs. It works especially well for design firms; like many consulting companies they sell to people who can't really evaluate their output. As long as they act with confidence, clients think they're brilliant.

Those designers (whose inflexibility, lets be fair, we encouraged by putting them through waterfall hell) have a hard time adjusting to iterative processes. They have to stop pretending confidence in individual designs, and instead develop confidence in their ability to fail skillfully. They are forced to confront the fact that they aren't artists, but instead are professionals who are there to accomplish particular business goals. And they have to learn to compromise gracefully with people of different backgrounds.

Hating all that forced learning is perfectly natural.

There are no comments on this comment yet.