"For example, in December 2024, we removed millions of pieces of content every day. While these actions account for less than 1% of content produced every day, we think one to two out of every 10 of these actions may have been mistakes (i.e., the content may not have actually violated our policies)."
That is first order data and it's interesting. However, before making policy decisions, I would want the second order data: what is the human cost of those mistakes, and what percentage of policy-violating content will not be removed as a result of these changes? Finally, what's the cost of not removing that percentage?
For that matter, by talking about the percentage of active mistakes without saying how many policy violations are currently missed, you're framing the debate in a certain direction.
May have been a mistake? Reminds me of RTO and the subjective feeling of being more productive in the office. They have the feeling they may have made mistakes and base their new policy on that feeling.
I don't think it's malicious wordsmithing where they are mis-representing the internal data, though I don't have the data to confirm.
The human cost of a piece of content being taken down depends on the piece of content, and the reason behind posting it.
In the case of someone posting about recovery from self injury and including a photo of their healed self-harm scars, having that taken down by mistake would be more harmful than someone who posted a cartoon depiction of suicide for the lolz.
My personal belief, for whatever that's worth, is that communication and speech are one of the most powerful tools any of us have. Talking can change minds, move societies, arouse emotions, and in general makes a difference. This is true no matter the format (text, voice, etc.).
That means that restricting communication should not be a casual activity. Free speech is a good ideal for a reason.
It also means that, if you believe in the primacy of free speech, you are obligated to consider the implications of that belief. Speech has effects. In my adult life, since 1990, we have seen a major change in the ease of communication. IMHO, society hasn't been able to fully adjust to that change -- or rather, that huge suite of changes. I sincerely do not know what a healthy society using the Internet looks like; I don't think we're in one now. All of these arguments (on all sides, mine included) are hampered by our lack of perspective.
Meta seem to be making the case for those who would see social media banned for people under the age of 18. To enforce that properly would require needing ID, and that then opens a whole can of civil liberty issues.
Yeah, making that my ideology is a hill I'm willing to die on, sorry.
If you or I happen to agree with the people who wield that power, rest assured it's only a temporary coincidence.
There's more people online than any of us has heartbeats, and the n^2 number of user-user pairs generates detrimental effects that track any positive effects.
Much better, I think, for each of us to have a small and private personal social network, not to hand everything over to a foreign* company trying to project its social norms worldwide.
* Facebook claims about 3 billion active users, so for 89%-93.5%** of its users, the fact that Facebook is American makes them foreign.
** https://thesocialshepherd.com/blog/facebook-statistics#:~:te....
I think this the wrong lens. The correct lens is: if they don't voluntarily make this change, will they be forced to?
The incoming administration seems committed to banning "censorship", so I believe making a cost/benefit analysis is something of a false choice.
FWIW I would not be surprised if the bluster about championing free speech abroad gets quietly forgotten; we’ll see. They explicitly state they will comply with laws, which in EU likely means continuing to moderate (more not less over time, given the regulatory trends).
I don't think this is exhaustive, and I think SSI (suicide/self-injury) + ED/etc. stuff is considered high-severity.
This is such a weak basis for suppressing open discourse. Have these studies been reproduced? What is the effect size? And why aren't you considering the countervailing harm to society of centralized moderation?
Are there reproducible studies showing that? What is the effect size?
(These objections go both ways!)
To see why, consider that the space of possible actions someone could not take is infinite. If there's an expectation that someone do a ton of research and work to argue for why they are not doing something, then the amount of work they would have to do is thus also infinite. This way lies madness, which is why in reality the default outcome that results from not acting is always taken as a given.
Sometimes this reality is obfuscated by activists. They find some group of people who are just doing their thing, and demand that those people do some extra things (usually some costly things). The arguments they make for this are weak, but when the targeted people say they'd rather not do those extra things the activists demand their targets argue for not doing what the activists want to whatever level of effort (or greater) they themselves made. This can be an effective bullying tactic but isn't legitimate: it's on those who want action to argue the case for it, not those who don't to argue against.
Digital platforms like social networks default to uncensored. If the operators do nothing, then by the way they are built content is allowed. It takes additional work to categorize posts and block certain kinds of content. So the default outcome is free speech. If someone wants someone else to do work to suppress that, then it's on them to prove that it's truly necessary and that the benefits outweigh the harms. But that doesn't cut both ways; it's not required for other people to take on the argument for free speech. That's the default outcome so it just wins by default if the other side can't prove their case to a sufficiently convincing level.
> Duty (criminal law), is an obligation to act under which failure to act (omission), results in criminal liability
You failed to act, which is why a law is sometimes required to compel action. However, saving a drowning person isn't something that triggers such a legal obligation in the USA unless you're the person who actually pushed someone into the water in the first place.
I don't get why this thread is getting so long or so abstract. The principles here are straightforward. Facebook don't actually have to care about what arguments activists make, but even if they did, it's on activists to win the argument for what they want. You don't get to automatically have your own way unless someone sits down and does a randomized controlled trial showing that you're wrong - and this is independent of what domain we're talking about.
Activists use abstraction to attempt to overcome settled understandings and norms. Of course there is a distinction between action and inaction—as you recognize it’s even a legally significant distinction. The very existence of that norm is the reason anyone would say “inaction is really a form of action.”
It’s like how the notion of “antiracism” is an effort to reframe race neutrality as a form of racism.
In this particular case, changing the rules (and making the blog post explaining those changes!) is pretty clearly an action.
But even if you want to play word games, choices and actions aren't the same thing. Choosing to act is quantitively different from choosing not to act because it involves a different level of effort. It's wrong to assume that they are morally equal.
The way I like to think about it is that once a choice has risen to the level of conscious awareness, it is an illusion that a person can just decline to choose.
Say for example I'm passing by a beggar on my way to work. Before deciding whether I give them money, I can first decide to ignore or not ignore them. From a basic human perspective I want to say hello and be friendly (and I choose to do this), but it does make me feel worse if I decline than if I had ignored them, exactly because it makes it feel like a choice. But if I ignore them, can I call passing by without giving them money less of a choice? I only moved my choice up one level in the tree of all possible decisions I can make.
Or, moving it to the example of the drowning man: imagine you're holding out your arm to see how long you can do it, and see the life ring flying towards you. If you choose not to act, it'll hang on your arm, and the person will drown. Is it nevertheless inaction on your part?
Though personally preponderance of evidence seems to be a shitty standard too because I might be listening to two awful theories and be forced to conclude one is the winner. Theories should rise above a minimum threshold to even consider sniffing at before we consider one as superior over the other.
Regarding my previous comment, my intent was to point out the GP comment’s position (because the parent’s comment seemed to be beside the point), not necessarily to endorse it.
Consider hate speech. There is a clear short-term benefit of moderation: reducing the harms to marginalised people from being exposed to threats to their person, identity, and way of life. In the face of this benefit, the absolute free speech advocate must provide a counter-argument for why free speech overrides that harm-reduction.
This only makes sense if you use a recent definition of "harm" created by censorship advocates that's divorced from the traditional meaning. In criminal law, harm traditionally (and still does in America) mean actually physically harming someone's body or making threats to do so. Censorship advocates are the ones making the claim that mere words should also constitute harm, so the onus is on them to justify why they want to change the meaning of the word like that.
Fraud can be criminal, without bodily harm or threats.
Verbal child abuse can be criminal, without bodily harm or threats.
There are lots of criminal harms not covered by your claimed definition in the American legal system.
Why are you not the one who must provide an argument for why this "reduction of harm" overrides the benefit of freedom of speech?
Further, a very large fraction of what I have seen classified as "hate speech" simply cannot reasonably be argued to constitute any kind of threat.
Finally: what do you mean by "identity"? When I have seen this term used by opponents of "hate speech", it generally seems to refer to something like a person's self-image. I cannot understand how this can in principle be "threatened", nor how it could constitute harm to learn that someone else sees you differently from how you see yourself.
There are some strong arguments for harm reduction being a more fundamental human value than freedom of speech. Firstly, the modern conception of freedom of speech is often seen to be grounded in libertarian thought, in particular the works of Bentham and Mill. Yet Mill himself explicitly stated that these freedoms should be limited in the case where they cause harm to others; freedom of speech has historically been seen as lower priority to harm reduction. Secondly, there are in fact two competing interpretations for "freedom of speech": on one hand the equality of access to a public forum, on the other hand the ability to say whatever you want. I say "competing" because in a public forum without moderation, the tendency is for loud and offensive voices to drown out the discourse, effectively leaving marginalised people without a voice. This is especially potent in modern social media. Thirdly, history suggests that it's problematic for ideological values to trump the basic tenet of harm reduction. We see this for example in the Catholic church's refusal to support abortion rights or the use of condoms to prevent AIDs. If we don't ultimately assess the long-term social impact of a "core moral value" in terms of harm and flourishing, then we risk entrapping ourselves in an ideological morass.
> what do you mean by "identity"? ... I cannot understand how this can in principle be "threatened"
As an example, homophobic comments are an attack on the sexual identity of homosexual people. It sends a message that they are unacceptable to society due to their inherent preferences, and that they should not express themselves as they naturally wish to. This causes psychological suffering.
Why? And how, in principle? Why is the burden of evidence not on others - and equally, how, in principle, could they furnish evidence?
The entire point is that freedom of speech is a core moral value; they have weighed the potential harms and come out against censorship, because they consider censorship to be inherently harmful. There is no objective way to compare different kinds of harm to each other; each individual's moral values are what they are.
When a free speech absolutist argues that freedom of speech is more important than whatever goal the censor has in mind, that argument is of fundamentally the same kind as the censor's argument, just with opposite polarity. When the censor says that "hate speech" needs to be prohibited, that, too, is based on a relative weighing of values and purported rights (i.e. freedom from hearing it).
Yes. However, I find this obsession with harm-based value judgment to the exclusion of all other considerations ethically problematic, to put it mildly. Ethics does not reduce solely to considerations of harm.
The content I'm talking about is graphic photos of suicide and self injury, fresh, blood soaked cuts, bodies hanging, graphic depictions of eating disorder (that goes beyond "thinspo", which is more borderline, and so downranked and not recommended rather than removed).
It's the latter that we believed (based on the advice of experts who we relied on for guidance) is harmful when consumed in large quantities.
I also think normalizing an infrastructure whose sole purpose is to suppress speech is ethically problematic. Rights are rarely expanded once taken.
You're right that people post abhorrent stuff on such sites, but I prefer approaches like filters over suppression. I also think that if reducing indirect harm is important to certain people (like reducing suicide), then there are known effective ways that don't require coercive power, like the public campaigns against smoking and MADD which have both had significant impacts.
I'm sorry, but maximalist free speech positions fail in the face of reality.
I believe it's only going to get worse going forward as they all adopt these policies.
They are admitting that there has been a global push against free speech on these platforms.
>There is research that shows exposure to suicide and self injury content increases suicidal ideation.
I mean do you really need research to show this link? Of course it does.
We are okay with slapping an “R” rating on movies and allowing parents to be the ones who decide what content their kids can see. Why can’t we decide that parents also need to be the ones to stop their kids from consuming bad content on social media?
But at this point, I'm siding with the "no social media for adolescents" people more and more.
Not to mention, people just straight up have a right to talk about these things. It is not moral to hold one person responsible for an unintended and not reasonably foreseeable reaction to the discussion. And joking about these topics is legitimately therapeutic for some.
I'm talking about graphic images of self harm, suicide, eating disorders. And at some point you have to weigh the maximalist interpretation of free speech "you have to host whatever I want, as long as it's not illegal" with "promoting this stuff causes active harm, no".
The burden of proof is on you to demonstrate that it causes such harm.
I don't generally think people should be held responsible for the unintended reaction to their speech of a small minority of the audience.
Also as per the inquest into the death of Molly Russel found based on the preponderance of evidence, exposure to this kind of graphic content was largely the causative agent in her suicide.
What would the bar you require be, is there a bar?
As someone who worked on harmful content, specifically suicide and self injury, this is just nuts - they were raked over the coals in both the UK by an inquest into the suicide of a teenage user who rabbit holed on this harmful content, and also with the parents of teenagers who took their lives, who Zuck turned around and apologised to as his latest senate hearing.
There is research that shows exposure to suicide and self injury content increases suicidal ideation.
I'm hoping that there is some nuance that has been missed from the article, but if not, this would seem like a slam dunk for both the UK and EU regulators to take them to task on.