Your comment that it "derail[s] a thread" makes the implicit assumption that the comments are actually off-topic. If they are on-topic, but you happen to have the opinion that they aren't (even thought they are) then it's not derailing anything, it's just a healthy reflection of the comment-generating process that is "the pool of all HN readers." I think of it like the John Lennon quote: "Time you enjoy wasting is not wasted."
I don't have a magic answer for how to accurately detect off-topic diversions in a way that satisfied most people most of the time. All I'm saying is that upon seeing a healthy back and forth, it should give me a lot of pause that if I merely think it's off topic, I am probably wrong, and it's just an opinion that should not be indulged by moderator activity.
There was another example of derailment recently, with a dozen comments arguing over what a "middleman" is when the original comment was really about how best to support indie makers.
Anyway, thanks for the interesting discussion, and I hope I haven't made this thread less useful for someone else in the process.