On busy HN topics, you can assume downvotes are just part of the noise and not worry about it. The arrows in the UI are so close together, it’s easy to hit the wrong one by mistake.

(Less charitably, for a busy topic the odds are there’s someone around for whom it happens to be their conspiratorial hobby horse and this manifests as downvotes on anything “mainstream”.)