Local standards also present problems. Do we really want to go along with e.g. Pakistan arresting people for blasphemy?
It's definitely true that anti-abuse systems can be themselves abused, though most of the systems that you're talking about are partly due to the anti-abuse systems being centralized, right? I also see a lot of comments here along the lines of "but that's censorship!" But the article is discussing decentralized anti-abuse systems which allow individuals to set up their own opt-in filters which apply to themselves and their communities (which means different people might have different filters). Do you think that's different?
The situation where A is sending to B something that's harmful to C cannot be dealt with by C's filtering and can only be addressed at a higher level in the system.
Those are the technical distinctions, but there's a lot of possible things covered by the second case: leaked nudes, lynch mob organisation, slander, leaked intelligence, compromised party documents, names of human rights activists being leaked to secret police, copyright infringement, child porn, fake news, real news in fake states, allegations that invitations to pizza are evidence of child porn, and so on.
Or various right wing ideas now softly suppressed on Twitter/Reddit.
Huh? If C knows A's public key and the content is signed, why can't C filter A's content?
That should tell you what was going on, especially when what set it off was an abuse victim warning that his abuser was capable of anything for self aggrandizement.
Candace Owens / Social Autopsy found that out when she started getting threatening and hateful emails from "gamers" on an address she'd only given out to progressive "anti abuse" activists.
No it didn't. It really didn't. No more than Twitter normally is. 'I hope you die' and 'I hope you get shot' aren't death threats, they're horrible things to say. There's a difference.
(mind you, the whole question of #twitterjoketrial was whether "Crap! Robin Hood airport is closed. You've got a week and a bit to get your shit together otherwise I'm blowing the airport sky high!!" constituted an offence against the Communications Act 2003 by being of a "menacing" character.)
There's multiple things going on here. We've seen use of communications channel A to organise harrasment on channel B - which is hard for B to stop ("brigading", gamergate). Gamergate escalated into real-life death threats against its targets. We've seen on-platform organisation of harrasment of people on and off the platform (this is ultimately what got Milo banned from twitter). We've also seen "news" organisations get into finger-pointing and condemnation of random citizens (e.g. Daily Mail outing a teacher as trans, resulting in her suicide).
We've seen the legal system get involved clumsily. There's seemingly no middle ground between "joke in poor taste" and "arrested for bomb threats" (#twitterjoketrial). Occasionally people resort to libel law, and even more occasionally the less powerful, famous and obnoxious person wins (Katie Hopkins vs. Jack Monroe).
People are I hope aware of the ability of abuse reporting systems to themselves become channels of abuse. Facebook's real names policy is exploited by anti-trans campaigners to force people off the platform, for example. Anyone should be aware of the risks of automated threshold systems being abused: if all you have to do is get 100 accounts to press "report abuse", that will be abused very quickly.
Local standards also present problems. Do we really want to go along with e.g. Pakistan arresting people for blasphemy?