(Of course, this is just my opinion. I have no idea if it's true.)
Further, if there are enough replies in a given thread such that your down votes on all of them were enough to lead to a ban, it strongly suggests that the thread really was on-topic, that it generated valuable interest and discussion, and that actually it's just a controversial thread (one you may not like perhaps), but clearly not off topic.
I do see this a lot on HN. When a thread is controversial in a way that HN group-think disapproves of, then "off topic" is used as an inappropriate excuse to down vote it, try to derail any discussion about it, etc.
For example, I think effectively all of the stuff from the subreddit TheRedPill is utter nonsense, and it's often very controversial and I dislike it when some of it appears here at HN.
But it's rarely actually off topic when it's brought up, and it generates actual community interest (usually from people who rightfully point out how problematic and baseless it is).
I'd rather that controversial topics and tangents, even when they are things I don't like, are permitted when they clearly generate community engagement, than to basically have some implicit HN blacklist of disallowed topics that are facetiously treated as off-topic as a way to simply exclude unapproved opinions.
One recent example was a useless conversation about whether the US was a democracy or a republic, with 10 different people saying the same thing. Those 10 comments with replies fill several scrolling pages, so the real topic of conversation is buried.
In fact, I think it would be a good thing if it was made impossible for moderators to detach comments that receive enough up-votes, or have child comments (especially comments that disagree) with many up-votes.
In those cases, it's clear that community members get value from the comment, which should infinitely override bespoke opinions of whether it's "on topic enough" to remain -- those subjective opinions ought to count for way less than simply observing whether there are up votes or replies.
Your comment that it "derail[s] a thread" makes the implicit assumption that the comments are actually off-topic. If they are on-topic, but you happen to have the opinion that they aren't (even thought they are) then it's not derailing anything, it's just a healthy reflection of the comment-generating process that is "the pool of all HN readers." I think of it like the John Lennon quote: "Time you enjoy wasting is not wasted."
I don't have a magic answer for how to accurately detect off-topic diversions in a way that satisfied most people most of the time. All I'm saying is that upon seeing a healthy back and forth, it should give me a lot of pause that if I merely think it's off topic, I am probably wrong, and it's just an opinion that should not be indulged by moderator activity.
There was another example of derailment recently, with a dozen comments arguing over what a "middleman" is when the original comment was really about how best to support indie makers.
Anyway, thanks for the interesting discussion, and I hope I haven't made this thread less useful for someone else in the process.
(I'm preemptively sorry if I end up delving into the realm of armchair psychology here)
Is it possible that, if you know you tend to look for authoritarian themes in the artifacts you interact with, that maybe part of your perception is the result of false positives magnified by the emotional impact of the administrative action?
There's always some subjective elements to imposing community rules as a moderator -- that's common in every community, ever. What would be less expected is malice in those actions.
I also don't think that bad moderator actions are common either. Most users probably don't even notice it. It's arguable that this makes it even worse, since it's harder to get the community to care about healthy community-approved policies if they are only protecting a handful of people who are sometimes outside of the HN group-think.
But what's far worse is that the moderation of Hacker News functions with very little transparency. Even just Googling for the moderator `dang` turns up a lot of angry rants on other blogs and in other sections of the internet, full of people who feel wronged by black-box and one-sided moderation.
It can be quite psychologically upsetting to post a comment, fall victim to group-think downvoting, try to add clarity or try to defend yourself against unreasonable comments, and then find yourself on the non-negotiable end of a black-box moderation action.
If it was just meaningless karma downvotes, few would care. It's the actually hurtful responses and, there's no other way to put it, mean-spirited moderation activity that give pause.
And I'm speaking as someone with a lot of anti-authoritarian tendencies. I'm not shy at all about speaking my mind and I struggle with finding a way to feign respect for authority apparatuses that are not legitimate, like HN moderation. If I feel this apprehension and backlash, I can only imagine that more timid readers feel it to a much more damaging degree.