But you still want to make sure that time is spent on the right thing. It adds no value to "go to town" for a week or two on features that nobody cares about, no matter how quickly you build them.

That's all the Lean Startup philosophy is saying: don't waste time building something that nobody cares about.

But the OP is right: it can be used as an excuse to not get anything done!