How about having the scores show up after a week (or X amount of time). Practically nobody votes on week-old posts, but I often use -- for example -- searchyc.com's average points per post to get a feel for a user's contributions.

That would balance the elimination of mob voting with being able to ascertain (historical) credibility.