Basically, they are the immune system of the forum, and we need those white blood cells. There's a downside, to be sure—HN certainly gets bad downvotes and flags. But there are mechanisms to address those, like corrective upvotes (https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...) and vouching (https://news.ycombinator.com/newsfaq.html), and as a last resort you can always email [email protected]. Meanwhile the downside of having no immune system at all would be much worse.
It is an endless tussle of how people want to be moderated. I definitely see the value of flagging given many if not all forums, commenting blocks and social media sites have that. It seems highly suspect to cast doubt on the value of it. Adding a low friction way to say "why" would give a way to add priority.
Second, downvotes are community driven and very useful where the participants use it to bring up quality content. Of course it can be used unfairly as well.
On the question of political topics on HN, I've written about this at length in the past: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu.... If you take a look at those and still have a question I haven't addressed there, I'd be interested to know what it is. Just be sure you've familiarized yourself with past explanations, because if the idea is something like "just ban politics" or "just allow everything", I've already explained many times why that won't work.