I use Analytics (Google Analytics, Woopra, GoSquared, and ChartBeat (although never at the same time, that would be ridiculous)) for two main reasons.
1) I enjoy looking at analytical data. Something about charts and graphs just intrigues me. Don't even get me started on the netflow statistics I monitor at my job.
2) It's fun to see how many people are viewing my posts. When I get a post that makes it to the front page of HN or Reddit and I get to see the hundreds of thousands of hits my page gets, it gets me excited to keep posting.
If a reader leaves early that's possibly a symptom of poor writing. If you're lucky, it was just the wrong topic for the reader: no shame in that. If you're unlucky, however, it may be that your content is confronting.
If you have good content but it's not presented properly, you're not going to get value across to the reader. They'll decide to skim read, skip paragraphs, or just leave the page altogether.
In a perfect world, the readers would comment about what was problematic about the article. In the real world, they don't. They don't comment as they don't feel confident to speak about the topic. They don't comment as they don't feel it's worth their time. They don't comment as they don't want to sound stupid.
If average time spent reading a page (culling the outliers) is about the same as what you'd expect to read the article, it's a good signal that you have the right content and the right method of presentation. Authors can use this to help bring content to readers in a clearer and more engaging fashion -- a win-win for all involved.
I should have specified that I was coming at this from the point of view that someone's writing a single page article or blog post with no conversion target other than to have it read.
If you're actually aiming to achieve anything concrete with a web page, then the only way to improve that is exactly as you said: directly track conversion to your goal.
The time on page can give you a relative statistic to compare your articles and develop a more engaged readership over the long term, not just optimize to try and sell them something right now.
An example would be something like patio11's posts, some of them are pushing for a conversion but I don't think that each would be best measured in terms of a conversion made right now.