I do that also but I upmod and downmod higher modded posts according to my opinions. It seems like a popular approach. I think that's why my favorite comments usually stay at 2.

The way to get a high modded post seems to be state a completely obvious refutation of a parent post. Saddly, I don't actually find such posts terribly interesting.

Fortunately, I don't think everyone posts for points here.