I was a moderator on a default subreddit for a year or two. I saw mods censor even relatively polite and thought out comments that had the "wrong" political message. In some cases nuking entire threads because they didn't like the ideas being discussed. This article gives solid examples of this tool filtering comments that happen to discuss Islam or terrorism. Likely the person who trained it had some kind of political bias that this tool is reinforcing.
On the other side of the coin, the vast majority of comments that should be removed aren't targeted by this tool at all. E.g. inane joke comments by people who were adding nothing to the conversation. These aren't "toxic" or harmful, but they take over and crowd out actual discussion.
Joking aside, this is why social science is inherently intractable. The only way to mitigate is to educate citizens, not censorship or regulations. But education is not only hard, also highly profitable...
The poster's point was that commercial platforms must address the same issue of undesirables. People realized that allowing the government to prohibit certain forms of speech has the negative externality that governments also gain the power to regulate all speech. On the other hand, corporations can never feasibly have that much power. They can only limit speech on their own platform. There's always another place to speak freely if you wish.
This is why I find the "free speech" argument for not regulating internet comments intractable. It assumes that since we don't want governments regulating all speech, we don't want corporations regulating speech on their platform. But that simply doesn't make sense for idealogical reasons, which I believe was the top-level poster's point.
Facebook has more users than any government in the world.
I think the correct idea is somewhat different. That we should be very careful in classifying speech as "troll" and extend the maximum effort in not using "unwanted behavior" as an easy substitution for suppressing dissenting opinion. There should be boundaries, and they should be wide enough to allow proper discussion - including challenging dominating opinions and expressing controversial and upsetting views.
> Automatic moderation won't be perfect, but neither will human moderation.
The concern is not that it will be imperfect, it's a given. The concern is that it would be less perfect than human one, while being perceived of being more perfect, due to the aura of "objectivity" that algorithms have. If a moderator unfairly targets you, you could complain about this moderator's biases, you could quote your interaction, you could appeal to other moderators or wider audience, you have plenty of options human interaction allows. You would not always get a just outcome, but there's some chance. If you are declared toxic by Google bot, what your options are? Argue with a bot?
Though some cases of online speech fall into illegal areas like harassment or threats, most "trolling" is just run of the mill speech. However nasty or mindless, it is for the most part protected speech.
Now of course Google and Facebook are not the government and are not bound by the first amendment, but you drew a comparison with laws. I think this is a poor choice of analogy as in this case, were google's program a law, it would be unequivocally unconstitutional.
That's just not how society works. All of our laws are fuzzy and open to interpretation. Everything is uncertain. But just because we can't robotically and unambiguously define all undesirable behaviour doesn't meant that we have to allow all of it. We don't have to let everyone do whatever they want in the comments section of every website online. We should do with online undesirables the same thing with do with any other kind of undesirable: shun them and remove them from polite society.
Automatic moderation won't be perfect, but neither will human moderation. I, for one, would be super happy if the bottom half of the internet were readable again.