People are bad at analysing metrics, too. You make a change and users spend half as much time on a page. Did you make the page twice as easy to use, or so bad that they gave up?