I agree. Unfortunately that's not the HR stance. I can't find it now but PG stated years ago that downvotes are appropriate for expressing disagreement on HN.

Also, I'm not sure votes count as moderation. Moderation is generally something that exists at a level above community feedback.