Obviously I don't think I should be downvoted either since it's an accurate comment. :) But I am quite fine with moderation working the way it does - it'd be better than arbitrary moderation "nuking" privileges.

A model where certain threads are curated and used to measure how valuable someone's voting is might be helpful in weighting votes. But that sounds like a lot of work for probably little reward.