For instance, the top comment at the top of the page may have 10 karma and 50 replies, while the next valuable comment has 15 karma (but was submitted 3 hours earlier), and isn't visible until halfway down the page. Without the karma displayed, it's much more difficult to skim the thread. And for all I know, the rest of the comments only have 1 point.
Plus, I recall from my reddit days that the earliest comments are way more likely to receive votes. So I always ended up trying to divide the karma by the time since post, which just distracted me.
Different strokes I s'pose.
What I recommended would encourage more voting, so you could just read the most highly ranked comments with some confidence about quality -- poor comments would probably be downvoted quickly.
I find that I often instinctively head to upvote a comment that has hit its critical mass in terms of karma votes regardless of its content. I have to take a second, back off from my instinctual action, and evaluate. Often I end up upvoting it anyway upon reading it, but at least then I have taken the time to evaluate it myself.
Not having the points present makes this problem go away because there is no implicit "lots of people like this, I probably will to" reaction. The jury is still out on whether or not I think things are ultimately helped or hurt by the move but I believe it is worthwhile for the sake of experiment if nothing else.