I think he means your overall karma (in the top right hand corner), not the karma on each comment.
An experiment would be to remove it, and only display it on your username page (as your average karma is now.)
I know he meant overall karma. That's why I suggested only updating it once a day, but you could still check how recent comments are doing with the "comments" link on the top bar, so you'd need to hide those scores too, hence my comment.
Something that could reduce the game-like unpredictable reward aspect of karma scanning might be to delay updating it, perhaps only once a day. But then you might fall back to checking 'threads'.
Perhaps only hide karma score from your own comments made more recently than a day?