There's multiple things going on here. We've seen use of communications channel A to organise harrasment on channel B - which is hard for B to stop ("brigading", gamergate). Gamergate escalated into real-life death threats against its targets. We've seen on-platform organisation of harrasment of people on and off the platform (this is ultimately what got Milo banned from twitter). We've also seen "news" organisations get into finger-pointing and condemnation of random citizens (e.g. Daily Mail outing a teacher as trans, resulting in her suicide).
We've seen the legal system get involved clumsily. There's seemingly no middle ground between "joke in poor taste" and "arrested for bomb threats" (#twitterjoketrial). Occasionally people resort to libel law, and even more occasionally the less powerful, famous and obnoxious person wins (Katie Hopkins vs. Jack Monroe).
People are I hope aware of the ability of abuse reporting systems to themselves become channels of abuse. Facebook's real names policy is exploited by anti-trans campaigners to force people off the platform, for example. Anyone should be aware of the risks of automated threshold systems being abused: if all you have to do is get 100 accounts to press "report abuse", that will be abused very quickly.
Local standards also present problems. Do we really want to go along with e.g. Pakistan arresting people for blasphemy?
Local standards also present problems. Do we really want to go along with e.g. Pakistan arresting people for blasphemy?
It's definitely true that anti-abuse systems can be themselves abused, though most of the systems that you're talking about are partly due to the anti-abuse systems being centralized, right? I also see a lot of comments here along the lines of "but that's censorship!" But the article is discussing decentralized anti-abuse systems which allow individuals to set up their own opt-in filters which apply to themselves and their communities (which means different people might have different filters). Do you think that's different?
The situation where A is sending to B something that's harmful to C cannot be dealt with by C's filtering and can only be addressed at a higher level in the system.
Those are the technical distinctions, but there's a lot of possible things covered by the second case: leaked nudes, lynch mob organisation, slander, leaked intelligence, compromised party documents, names of human rights activists being leaked to secret police, copyright infringement, child porn, fake news, real news in fake states, allegations that invitations to pizza are evidence of child porn, and so on.
Or various right wing ideas now softly suppressed on Twitter/Reddit.
Huh? If C knows A's public key and the content is signed, why can't C filter A's content?
That should tell you what was going on, especially when what set it off was an abuse victim warning that his abuser was capable of anything for self aggrandizement.
Candace Owens / Social Autopsy found that out when she started getting threatening and hateful emails from "gamers" on an address she'd only given out to progressive "anti abuse" activists.
No it didn't. It really didn't. No more than Twitter normally is. 'I hope you die' and 'I hope you get shot' aren't death threats, they're horrible things to say. There's a difference.
(mind you, the whole question of #twitterjoketrial was whether "Crap! Robin Hood airport is closed. You've got a week and a bit to get your shit together otherwise I'm blowing the airport sky high!!" constituted an offence against the Communications Act 2003 by being of a "menacing" character.)
The problem does have a way to solve itself, but that probably involves the model we see here on HN, which admittedly is preferable to the model of a locale such as Reddit. That said, each platform is going to want to address the problem on a faster timeline, because the problem directly hits their bottom line.
I agree that the technology exists (and plenty of other solutions mentioned in the article). But saying that because the technology exists and hasn't been deployed therefore there is no abuse problem is a hilariously bad non sequitir.
Consider SMTP, which is a true peer-to-peer system. In SMTP, abuse is a solved problem - spam filters work great, and 33mail/mailcatch (disposable email) improves things tremendously. At most 1-2 recruiters/SAAS offering marketing automation/etc slip through my filters each week, forcing me to expend about 3-5 seconds/week clicking "report spam".
The "abuse" problem on twitter is similarly not really a filtering issue; if it were, then it could be easily solved by a moderately better twitter client or switching off notifications of @mentions.
No, the actual problem people face is that they want to stop others from speaking, and label the speech they wish to stop "abuse". What's scary to most (including me) about Twitter is that an angry mob may form and decide they hate me, and then use Twitter to coordinate real life actions against me.
That's not a problem of abuse on the platform; that's a problem that the platform enables people to speak among themselves in ways I dislike. Lets be clear that this is the problem some folks wish to solve. It's only by identifying the problem that we can properly solve it, or decide if it's a problem that should be solved.