People are downvoting you because they disagree with you. This is not against the rules (https://news.ycombinator.com/newsguidelines.html), whereas commenting on it is. You are punished for difference of opinion and you can't complain about it.