News for hackers. Stuff that matters.
Re:Tell HN: New Google homepage, A/B testing gone crazy. by jessriedel on Wednesday May 12, 2010 @05:33PM (#1342338)
Intuition/experience is important when there is some aspect of reality that is hard to measure. Insofar as the data tracks your target, intuition is unnecessary. That's why I would want an example in which data was failing.

For instance, a fast food chain might take some data and find that they can decrease the quality of their ingredients without immediately loosing customers because people have habits and don't really notice right away (and because consumers will chalk up a few bad experiences to variance at a place they know well). But, over time, the chain develops a reputation for lower-quality food, and customers slowly leave.

The problem with this example is that the data can easily measure long-term effects, especially the subtle damage to reputation. This is a case where intuition may be needed to override data.

But where's the similar example with Google?

There are no comments on this comment yet.