But there's more at play here. I briefly worked on Twitter's anti-abuse engineering. Many of the people on that team cared a lot about protecting people. I sure did. But we didn't have the necessary power to actually solve the problem.
The people who did have that power were senior execs. They might say that they cared. In their heart of hearts, perhaps they even did. But their behavior demonstrated that they cared about other things much more.
My boss's boss, for example, was an engineering leader who had a climber's resume: quickly advancing through positions of more and more power. In my view, he cared about that a great deal, and did not give a shit about the actual harm to users. As soon as he got the chance, he pushed out my boss, laid off the team's managers, me included, and scattered the people to the wind.
I presume the same was true about the senior execs. They were aware Twitter was causing harm to people. If they wanted to know the details, we had plenty of research and they could have ordered more. Did they care? Impossible to know. But what they focused on was growth and revenue. Abuse was a big deal internally only as long as it was a big deal in the press.
That's probably true but not at Facebook's scale. If the employees are willing to accept the argument "We could have increased profit but chose not to in the interests of users.", because everyone's bonuses and stock value is based on profit, you'd need to hire a lot of people who are happy to trade some amount of personal gain for user wellbeing. That would be difficult when you have tens of thousands of people.
Alternatively, maybe it'd be possible to run Facebook without giving the staff equity or bonuses. That would take a huge shift in the way tech renumeration works though.
That is not necessarily true. If FB where a place where people could feel proud of the good it does, a lot would be ok taking a pay cut.
Sure, maybe the ones that care the most about compensation wouldn't join, but that might be ok.
I worked previously for a for-profit company which was devolving a massive amount of their profits to charity. It was something I was proud of, and a part of my evaluation of how much I liked working there.
No. Due to network effect successful company must be large, and the large company lives by different rules. FB for example is a trillion dollar company. It is like a TeV energy level in physics. Different behavior of matter. At those energy levels chemistry for example just doesn't exist, and matter itself changes as protons break apart. Ethics in big business is like chemistry in high energy physics - it just doesn't exist at those levels of money. At these levels they can be affected only by comparable level of money or power, like the government power.
And how do you break them up? By geographic area? People would be pissed because they have contacts with, or maybe want to watch vacation videos from people from different areas.
IMHO the only options would be:
* non-profit run by the UN or similar
* forced to open all data and APIs to make it a platform, with rules to make it an even playing field
In both cases with much less, and why not zero, "engagement" focus ( just show the latest stuff chronologically from the things you've liked/subscribed to). Could either work? No idea, but seems to me that they have better chance than a Facebook per country or region.
Of course, it does cost more, so the question becomes who is willing and able to pay for a socially less harmful means of networking individuals without having to put them all on a single data hoovering ad platform? Whether it's direct charge to consumers or subsidized by government, the money still ultimately has to come from people.
Hey, if they get that implemented for Facebook, maybe they can try to make it work with health care records too. Good luck with that...
Implement ActivityPub (an existing protocol recommended by the W3C), and offer their underlying social networking services as hosted and managed software for big orgs to operate on their own domain. With interoperability, they'll work across domains. Target customer is anyone with at least 100K followers (so gov, institutions, media, et cetera).
It should be run independently, like the WHO, not directly under the power of the security council. And before you say Taiwan, the Republic of China is not a UN member, and there's nothing the UN or WHO can do about it, it's between China and them.
I am familiar with the extreme lengths China would go through to prevent discussion on topics it hates though (e.g. if HN was based in China both of our comments would have been deleted immediately)
Did you hear about federation and inter-compatibility between different network? Have a look at how Mastodon works.
The social media is like tobacco, and FB increasing the engagement at all costs is like when Big Tobacco were increasing addictiveness of the cigarettes. Like with tobacco, the way to deal with the issue is to wean the population off by in particular educating the population about the damage it does to them .
Btw, "Statement from Mark Zuckerberg" - that reminded that foundational tenet of Facebook :
Zuck: yea so if you ever need info about anyone at harvard
Zuck: just ask
Zuck: i have over 4000 emails, pictures, addresses, sns
Friend: what!? how’d you manage that one?
Zuck: people just submitted it
Zuck: i don’t know why
Zuck: they “trust me”
Zuck: dumb fucks
But FB isn’t a social network. It’s an engagement farm and advertising platform that abuses a social network to drive its business aims.
It’s quite hard to see how it’s just a business that doesn’t give one shit about you no matter now many followers you have or how many likes you got when you’re still using it.
An actual social network would care how you feel today.
As an aside, I'd like to make the broader point that boiling everything down to "Facebook=evil" doesn't seem like a productive way to get the changes that I think both of us would like to see. It walks right into the strawman arguments that Zuckerberg is responding to in his post ("Why would we invest so much in trust and research if we didn't care?"). And it doesn't capture the fact that Facebook is a huge entity comprised of a lot of people, many of whom have different incentives and some of whom are even trying to do the right thing (see: Anna Haugen).
In 2007 or 2008 I promoted the idea amongst my friends to “poison the well”, to feed bad data into FB’s algorithms. If they enjoy Coke, talk about Pepsi, I said. If they vote Green, share far right news. I called it Falsebook.
It didn’t work, because the problems inherent in the advertising auctions are not very visible to users. They mesh with the echo chambers of our friend circles and fizzle into the background. We seek out echo chambers in order to feel safe and validated. It’s mostly fine when it’s just humans relaxing with friends. But when that echo is robotically generated from an accurate model of all individuals involved, it can be leveraged for all sorts of big scale shady crap. Advertising is the village idiot of this town and corportate-backed political propaganda is the warring gang lord.
And Zuck does what any market owner does.. sits back and rakes in profit, cleaning up the mess when it suits him. And mostly it doesn’t.
I’ve never felt it could be fixed from the inside. I’ve never thought it was a good idea to begin with but I let peer pressure and my magpie nature suck me in. I regret signing up for FB and GMail back in the day because corporate surveillance has fucked our society hard and let sociopaths run rampant.
You will not change my mind. I wasn’t contributing to the conversation in good faith. I shall assume you were. My original glib comment about FB abusing social networks wasn’t an invitation to learn a new perspective, it was a war cry, a flag raise, a call for comrades. I was hoping someone would respond with links to a new Scuttlebutt implementation or tell me about a cool Masto instance. Or try to explain why I should bother with Matrix. Or something more interesting than all of those.
The web is sick. Personalised advertising has made it ill. We need to fix it and I don’t believe FB or GOOG are interested in trying.
Yeah I don't know that anyone could have predicted these networks would become too massive to displace. Intervention should be on the table, no doubt about it. I hope they bring up net neutrality and Facebook's violation of it via internet.org. I thought "Free Basics" had died but apparently it's still going.
They care about their own kids more than they care about abstract faceless millions of other kids on FB. Moral bankruptcy starts when they harm other kids in order to put food on a table for their own children. I would not be surprised if some of the FB's employees ban their kids from using it.
1: https://www.ribbonfarm.com/2009/10/07/the-gervais-principle-...
My guess is that execs would have been very happy if we could have quickly solved the problem in a way where revenue and growth were not harmed and nobody important had to go out of their way.
But online abuse isn't like that. It's a hard problem. So I think execs were satisfied to say they were making a big effort, celebrate some modest gains, and then stop thinking about the problem once it wasn't a giant PR/regulatory issue for them.
So it's more like how a lot of people mean to get fit or lose weight. If it's New Year's Day or their doctor scares them enough, they'll get real serious for a while. They probably do mean it, but they mean a lot of other things too, and those win out.
Or alternatively, we could try to view this as the root problem and try to fix it.
Edit: Note there is also a difference between "not having social good as their primary goal" and working effectively against the social good, whether intentional or not.
Edit2: Explanation of the downvote would be nice.
Then the doctor tells them again you need to go on a diet or you will have a heart attack, and they go on the diet for a couple months.
having a heart attack may solve the issue.
Of course there are clear eyed people who see the situation for what it is, those that stay on don't care and consider the efforts to fight abuse as a Potemkin village.
My team was sincere, worked hard, and definitely got some good stuff done. Just not nearly as much as we wanted.
> the main benefit your team provided was PR/regulatory cover for the organization
This sort of reasoning seems to be applicable on many levels of social organization, from brains to countries. Most of the stuff your brain does is for show / self-delusion, most of the stuff any community or global organization does is also for show / self-delusion. It's "Potemkin villages" all the way down.
Regulation would be awesome for Facebook: not only would it be a fig leaf for all their social problems (“hey, it’s not our problem anymore”), it would also stifle any potential competitors out of their market. The costs of regulation are regressive: much more easily absorbed by BigCos than any startup.
Another possibility is that Facebook knows that asking Congress to do something is either a) not going to increase the odds of them doing anything, b) actually decrease the odds by sounding contrite, or c) puts it in a place where Facebook's army of lobbyists and otherwise connected individuals make sure nothing meaningful will get passed into law.
It's not a bad bet given how polarized Congress and the American electorate are. And gosh, who is a big enabler of that polarization?
In the end, there is no algorithm which can match the scale of bad content, no robust definition of bad content which can work without creating a flood of false positives.
Every false positive is now someone who had something valid to say who is silenced.
How are we going to decide which grey area speech is unwelcome (leaving out obvious things that are illegal).
———— The popular idea is increased human centric moderation, but thats still going to be 2k email escalations for one region per day, at a 10% escalation ratio from a base of 20k.
Prior to the late 2000s, this problem didn't exist. In alternate universes, it surely doesn't; there are many ways this could have gone.
Of course, it's pretty clear by now that there isn't going to be a magic bullet that is going to make everybody happy.
Instead we need to target Ads. Almost all problems can be eventually traced back to ads. At the very least traced back to the money incentive that ads create, on any platform.
I would go one step further and suggest that ads are an issue for certain types of Economic games or Markets.
Any industry that depends on Ads tends to consolidate, and has an issue of incentives - the more people on the network, the more likely the network is able to survive.
On a tech forum people assume that challengers have better tech - but I would argue that challengers actually allow for more salacious/engaging content.
This is what creates the race to the bottom.
If the race to the bottom can be stopped - i.e. an incentive structure created that stops engagement being the primary metric, then the rest of the downstream problems are largely prevented.
Thats my root cause assessment of the situation. However once I get to this point, any solution seems to be a mess of intersecting fields ranging from morality, legal constraints, issues with press freedoms, free speech etc. etc.
So... I guess how do we set up incentives to not allow the most "engaging" content to dominate?
d) He realizes that there are opposing factions with different ideas of what needs to happen, and it's impossible for his company to please them all, so pushing the decision to some semblence of a vote that claims to represent everyone is the only way to put an end to the endless arguing.
or
e) He believes what he wrote and doesn't think these social issues should be decided by corporations.
Either interpretation is fine and a lot more generous than yours.
Simply because there was enough regulation in place in that area that they didn't exist in the first place
Could this just be an issue of too many problems to care about and not enough time to solve them all or do you think the indifference was intentional?
If you optimize for profits and only that, you always end up selling crack cause it's the best business in the world, and that's why it's illegal.
The truth is that almost anybody could sell crack. Most of us choose not to.
I can't know what they felt when they made those choices. But I can see the choices and the outcomes. I get there's some theoretical difference between willfully fucking people over to get rich and being so blinded by eagerness to get rich that you fuck people over as a side effect. But either way they worked very hard to get positions of power that affected millions and then were indifferent to the harm they caused, so it's not like this happened by accident.
But if there somehow weren't ways to measure it? Then they would have created a product where they couldn't even tell that they were harming people. That right there is something that shouldn't exist.
Even worse, preventing abuse and other social media ills often lessens engagement, and you know what that means.
Quite a bit, then?
When an organization becomes too large or bureaucratic, these Dark Triad types hide and typically exert their influence and power and will behind the scenes. This is why these companies seem “evil”, but it’s usually not the founders’ fault, a lot of times they’re unaware of it, or one of the founders is also a sociopath and will protect the evil cabal. That’s my two cents about it anyway.
Here's an real life example: I worked for a small startup years ago and the founder invited the engineering team to lunch at a restraunt. The founder proceeded to berate the waiter for no reason and yell at him, it seemed like completely psychopathic behavior and then I caught the smallest of smiles from him after the waiter walked away beaten up(metaphorically speaking) by the barrage. I knew right then this person was not someone I wanted to work for and put in my notice shortly after.
A few high-level folks arrived whose perfection in smooth talking was rivaled only by their enjoyment of wreaking havoc on teams & relationships. They brought in their friends, paranoia and rumors spread, culture went off a cliff, CEO was confused what happened. Mass exodus followed.
For software development, that's the opposite of what I want. Some of the best people I've worked with were terrible at interviewing. But once we got into actual code, they settled down and their skills shined through.
This assumes you are more intelligent than them, and can see through their insincerity during an interview process.
But have you considered that these "smooth talkers" can be smarter than you? Or at least have been perfecting their BS craft (while you perfected yours, such as programming), so that you are absolutely no match?
edit: Took me down memory land to re-visit some truly incompetent and insanely unproductive bootlickers and fast talkers who would lose their job immediately after a 5 min confidential talk with any of their underlings.
And then you would have the truly exceptional people, that manage to combine the ruthless drive needed to grow a successful company, care about their people and have the capabilities to keep those bad actors out, or at least in check. I saw maybe 1.5 of these people in management functions, middle management that is. Not sure of those black swan unicorns exist as founders so.
Isn't it just about that in the end? I think being good or not is about whether you give yourself the room to do the right thing even when other pressures exist – because they always exist.
Being good can be hard, because sometimes it means you have to abandon your usual priorities and stand up to the consequences which will emerge from that decision.
Haugen repeated over and over again her testimony today that Facebook is full of smart, thoughtful, kind, well-intentioned people, and that she has great empathy for them, even Mark Zuckerberg. Her point is that they have created a system of incentives that are inexorably leading to harmful outcomes. It is not about good and evil people, it is about the incentives. It's exactly as you are saying.
That's why she is not advocating to punish Facebook for being evil, but rather to force Facebook to reveal and permit research so we can understand the system and fix it, because Facebook is too deeply trapped in its own tangle of incentives to fix itself. In this I think she is absolutely correct.
The message 'you can save all this money, using us!' always means 'you can spend all this money with us'. I'm not faulting the general system or even your point here: I am, however, suggesting that while the system is fine it does NOT in any way imply that such people have or feel ANY incentive to your well-being.
You could maybe make a case that such a company might feel an incentive to the POPULATION it depends on… but even then, I feel like that might be mythical. In theory you don't want to eat your own seed corn, but such incentives toward good behavior are so easily ignored… and even if they are honored, it's a collective concern, NOT personal.
They don't care about you, and you are damn lucky if they care even a little about your wellbeing as a class or demographic… most likely they do not. And that's where the system tends to break down.
Their incentive is to find a way to get your money; we can see in the world around us that many of them have no problem if you're insecure, addicted, and indebted.
So what ways would influence your outcome to actually happen? Because I think it would be the right way to run software platforms as well, I just don't see a pathway there that isn't heavy handed.
I would be for regulating the advertising industry, since I feel it is the root of all this. None of the unethical software magnates would exist if not for the advertising dollars pouring through the door thanks to the ad-tech apparatuses they have built, and the poor incentives that creates. But that regulation is challenging and unlikely too.
For example, maybe an account with 1,000 friends is free. Up to 10,000: $5 / month, up to 100,000 $50/month, and so on.
If you're Kim Kardashian with 250 million followers and you're making millions of dollars hawking skin cream or whatever, you can afford to pay a few thousand dollars a month to reach your large, valuable audience.
This way, the content creators can sell ads if they want. The platform doesn't sell ads. Users only see ads if they follow a creator who has sponsors. It's up to that creator to make their content worthwhile enough for people to choose to follow them in spite of the ads.
A platform should be like a company that sells TV broadcast towers. They give people a way to reach an audience. What that content creator does with their audience is up to them. Maybe they could charge a subscription. Maybe they get sponsors. If it's a large non-profit or government organization, maybe they pay at a lower rate or get to use it for free.
Relevant testimony here: https://twitter.com/gillibrandny/status/1445451624005001217
Remember, this is the system of incentives that had us spend 20 disastrous years in Afghanistan, across both parties. And has failed to deal with climate change. And healthcare. And education. And wealth inequality. And housing. And... Siri, what's the definition of insane?
Senator Gillibrand: "We need a Data Protection Agency."
Frances Haugen: "And there needs to be a regulatory home where someone like me could do a tour of duty after working at a place like this"
It creates a Hunger Games mentality within teams and makes doing anything that actually matters virtually impossible, generating an infinite sequence of half assed 6 months projects that get systematically abandoned as soon as the people responsible manage to get promoted or switch teams.
Unless you mean the Florida Public Service Commission, PSC Motorsports, or Pensacola State College you're going to have to be more specific.
At least according to https://www.thelayoff.com/t/13z18mcE when I searched for “facebook psc”.
That's a bit of an over dramatization, PSC is just peer feedback, and is very similar to Perf reviews at Google as well as other large SV tech companies. Having done both I didn't experience this "Hunger Games mentality" you described.
If the people inside are "smart, thoughtful, kind, well-intentioned people", they would have tried to work around the incentive, influence them, denounce them, or quit.
It rarely happened. Most of the time, the just take the money, and goes with the flow.
Getting past the illusion was hard.
Taking a stand against said CEO while nobody else was aware of the problem? Really, really hard.
Now, instead of a few dozen employees, Facebook has tens of thousands. I assume that all of them are subject to permanent propaganda, as in many tech companies, and that the semi-official word is that they are being misunderstood by the rest of the world, because of course they are doing the right thing but the problem is harder than people think (well, that last part is true, at least). I suspect that it's even harder to go against the flow.
these days research comes with a set of politically charged assumptions, for example the definitions of "hate speech" and "misinformation" are different based on which political camp you ask
So giving access to Cambridge Analytica is bad but to some other partisan "think tank" is fine? who would make those decisions?
Imagine if you were trying to fix climate change, but under the condition that you weren't allowed to burn fewer fossil fuels. You may try very hard, and very sincerely, but it's fool's errand.
> I don't think it's an emergent property, I think it's a by-product of the constraints. > Imagine if you were trying to fix climate change, but under the condition that you weren't allowed to burn fewer fossil fuels.
There is one person who controls all the constraints: Zuckerberg. He even went so far as to enforce that through his stock classifications. It’s entirely understandable and acceptable to have empathy for those working at FB who are attempting to solve the problems. But Zuckerberg made the decision to be the single source of the constraints that bind everyone below. And his constraints are: profit over all else. He should face consequences for setting those constraints, just as anyone should who set a constraint of “address climate change without adversely effecting GDP”.
Separately, and as the “revelations” of Zuckerberg’s immoral behavior continues year after year, those who work for him but are attempting to solve the problems, should recognize at some point in the future, now, or in the past that the problems are insurmountable within the confines of the constraints. As that knowledge spreads, then the question becomes whether those idealistically earnest individuals are justifiably ignorant of the reality: that all their best intentions are moot in the face of the constraints as were determined by Zuckerberg. And when or if they are no longer justifiably ignorant, they become culpable.
But due to whatever reasons (ego, greed of seeing his net worth rising and fear of losing some of it etc.) he won't take morally right step that would harm FB's financials in any way.
On top of that, let's be clear - the mission of FB never was some altruistic connecting the world, in contrary - it was all that juicy private data on each of us while we are connecting and interacting, quietly building a shadow profile for every single human being. There is no moral high ground there no matter how much mental gymnastics you try. If FB would somehow leak those data publicly, the company would go bust very quickly.
In more than 1 way, I struggle to understand these whistleblowers - they get hired for tons of money into company with clearly amoral (or at very best dubious) mission and then they are surprised when it actually is... Similar case would be going to investment or private banking and then being surprised how business is set up and how decision makers in it behave
I personally do not buy the “in over his head” argument, fwiw.
I like this. This helps me. Thanks.
This also happens to be the literal policy towards climate change of China. They announced the pause of funds for external coal plants, doubled down on their internal ones.
To extens the metaphor, Facebook's "alternative energy" is non-advertising based revenue. I see zero efforts from facebook to move away from ad based revenue so there is zero chance that Facebook is going to make meaningful progress in changing.
Portal hardware. Oculus + Game Store. Facebook Gaming.
Lots of projects, no stable hits.
When that emergent behavior both increases profits and takes advantage of your customers in negative ways, the relationship moves from something symbiotic to something parasitic. This is where it begins to cross the line and people start throwing "evil" around when describing you.
I don't think most companies are out to create a worse world, but many do it until they are forced to reset.
Conflicting goals. And the one you want to fix is secondary to not losing money.
Although if this plan were viable, one can imagine the Zoloft marketing department would have already purchased the ad space. The limiting factor is probably the need for a psychiatrist to approve a prescription for every patient. Most users in developed countries are already eligible to get the itself drug for free, or at least cheaply.
Ah, this is what I think of as Schrodinger's Accountability. Zuckerberg and Facebook's senior execs are simultaneously: A) so brilliant for running Facebook that they deserve to be incredibly rich, and B) so normal that they can't possibly be expected to understand the consequences of their actions, and so are morally blameless. Heads they win, tails we lose.
I say it's one or the other. If Facebook is too big to be understood, it should be broken up into small enough units that mere mortals can see the forest and tend it responsibly. And if not, the execs should be morally and legally culpable for the harm it does.
And yes, I think we should change the incentives. We should change them such that executives face direct personal punishment for negligent or intentional harm. We should have learned that lesson during the 2008 financial crisis, but instead nobody did time. The worst that happened was that some very rich people were forced to give back a modest percentage of their gains.
>>We should change them such that executives face direct personal punishment for negligent or intentional harm. We should have learned that lesson during the 2008 financial crisis, but instead nobody did time
does not contradict anything else.
But this
>>So either this is exactly what they want or they're hopelessly incompetent.
is incorrect. Those are not the only two options. Reality is typically more complex, and more boring than that. Doing harm does not require willful malice or profound stupidity and trying to reduce it down to that does no one any good.
Not that after investigation we could find that it was really one of those two cases for many people! But 'negligent harm', which is something you want people to be held accountable (me too!), does not require gross incompetence. It can be as simple as ignoring a couple inconvenient truths and being insulated from the consequences of ones decisions, or the cumulative outcome caused by the group.
Think of it similar to handling explosives. Are they useful and important in society? Definitely. Are they subtle and complicated, such that working with them can easily harm somebody in ways that are not foreseeable to the naive? You bet.
But when somebody decides to create and apply explosives and hurts somebody, we don't just say, "Gosh, that's very complicated. Who could have known how it would work out?" We say, "You intentionally chose to work with something powerful and dangerous, so you're responsible for the harm you caused."
Is it more complicated? Sure. And I'm saying that when it comes to highly paid executives who seek out positions that put them in control of dangerous complexity, they become responsible for the outcomes.
They are already seen as responsible when it comes to anything good that happens on their watch, which is why they get paid such fast sums. I'm saying they should be seen as equally responsible when it comes to the harms. No more of this, "Oops we crashed the economy/poisoned a bunch of people/actively enabled genocide" stuff. All of that "more complex" reality becomes their problem if they are in control of it.
I think the definition of success they're operating under is vastly different from yours.
And I think it dramatically aided early internet adoption. If you read "When Wizards Stay Up Late" you'll see how big a barrier AT&T was to the adoption of packet-switched networks, rather than the circuit-switched networks they sold people. How far would the Internet had gotten if AT&T had banned home modems [1] or priced early ISPs out of existence? They would have vastly preferred something like AOL, not the Internet, which destroyed their long-distance call business entirely. Look at how they behaved with mobile apps up Apple launched the app store.
Our problem was that we didn't stick with it. Starting in the Reagan era, antitrust enforcement shifted toward much laxer standards. So AT&T reassembled itself as a (smaller) juggernaut and kept going.
[1] I realize this sounds insane now, but one of the things the DoJ sued for is "Obstructing the interconnection of customer provided terminal equipment and refusing to sell terminal equipment, such as telephones, automatic answering devices or switchboards, to subscribers".
You mean a competitive environment like this one? https://www.beingguru.com/wp-content/uploads/2019/06/top-mes...
Those same people are protecting their children with $300k+ salaries and buying property in area where they can send their children to Gunn HS. While I empathize with these people the direct opportunity to protect your kin should not be understated. Do they mean well? Sure. Are they putting their best effort to fix things? Sure.
Here's the most important part:
Do you they know deep down inside that the only way to fix these things is to hurt Facebook financially? Probably. But they also know this means risking to protect their own children as a result (forced to move, lose job, less pay, etc.). What would you do? (I think I know the answer)
This can't be understated any further - in the end it doesn't matter what individual people at FB think because no one person or group of people has any legal, economical, or logistical ability to control the company except Mark Zuckerberg. He is figuratively and literally impossible to fight. Well, unless everyone deleted their accounts.
The crazy thing is that FB has taken steps to improve things in past that also hurt them financially (eg post cambridge analytica) . They just make so much money and so fast that its like 1 or 2 bad quarters and its over.
So (1) mark being all powerful means he alone can decide its worth lower profits - he's done it before.
(2) The loss of profits probably wouldn't even matter.
people need to interact with facebook non-stop for it to remain relavant
Outrage attracts attention in all group interactions. I can't think of a single large scale group forum where this isn't true. It's integral to an absurd degree in our news cycle. Howard Stern exploited this property in his rise to fame. It's a core element in state propaganda, well documented throughout human history.
I'm old enough to remember when the internet was a lot more free - when there generally wasn't some parent corporation imposing content censorship on what you put on your homepage, or what you said on IRC. All of the complaints regarding Facebook were true of internet communications back then too (on the "sex trafficking" issue, compare to Craigslist of yore!)
The big difference seems to be there's an entity we can point a finger at now. Communications on Facebook aren't worse than what was on the internet two decades ago. In fact, they're far, far more clean and controlled.
What I look to is whether Facebook is more objectionable than alternative forms of communication, and I can't find any reason to believe that this is the case. Is twitter better? Is reddit? Is usenet? No.
So why does Facebook draw such ire?
Are people calling for controls on Facebook also calling for controls on self-published websites? On open communication systems like IRC or email? Where is the coherent moral philosophy regarding internet speech?
To be honest, my biggest concern when I read the news surrounding this issue is that most of the internet might not be old enough to remember what it means to have a truly free platform, unencumbered by moralizing. Why are people begging for more controls?
But I think there are a few key innovations that make FB worse for human psychology than previous iterations. Chief among them is the algorithmic newsfeed designed to drive engagement. Outrage certainly provokes responses, but in a chronological feed situation, eventually threads would become so large that the original outrageous situation would be pushed far back and the outrage would go away. Algorithmic newsfeeds bubble these to the top and continue to show them as they get more comments/retweets/shares/etc. They reward engagement in a visceral way that offers perverse incentives.
Secondly is the filter bubble. By showing you content hyper-relevant to your search interests, you can easily fall into echo chambers of outrage and extremism. Internet communities, like IRC channels, had huge discoverability issues. Each community also usually had disparate ways to join them adding another layer of friction. Even if you were an extremist it took dedicated searching to find a community that would tolerate your extremism. Now mainstream platforms will lump you into filter bubbles with other people that are willing to engage and amplify your extremist posts.
Combine horribly narrow echo chambers with engagement-oriented metrics and you'll have a simple tool for radicalization. That way when you're thinking of committing a violent act because of the disenfranchisement you feel in your life and your community, you'll be funneled to communicate with others who feel similarly and enter a game of broad brinkmanship that can quickly drive a group to the extreme. Balkanization and radicalization.
This is such a great point. The pre-Facebook Internet was full of anonymous random garbage. But everyone knew it was inconsequential garbage. Adding real names and likes changed all that: today garbage has gained legitimacy and is displacing prior forms thereof.
If there's one thing I've learned it's that the outrage never goes away. The type of people who fixate on outrage in their Facebook feeds are the same type of people who decades prior would cruise around town picking fights in person. I'm unconvinced that Facebook is meaningfully changing this dynamic.
I'm also unconvinced that the filter bubble is meaningfully different than what's come before. Humans have been sorting themselves into like-minded communities since before we could read and write. Do you remember the hive-minds of the 80s and 90s? If anything they were far more extreme because of the difficulty in proving anything, back before google and wikipedia. There was a lot more extremism and hate based violence back then. A LOT, LOT more, and no interventions like Facebook is at least attempting to provide.
Facebook has some new angles on old patterns in human behavior, yes. I think the people who're trying to show that it's made things work have a lot of work to do to make a compelling case. Facebook's biggest transgression is probably that it has chronicled this behavior and has dragged it into the light.
However for the last 10 years or so grievance culture has taken root and not only excused outrage, its proponents have actively encouraged it.
It makes me think of that scene in Star Wars where palpating is like “good, good. Let the hate flow through you”, expect we now have millions of people encouraging this.
How I wish we could rewind things to a world where foregiveness was still a virtue and we were all taught that sticks and stones may break our bones but words will never hurt us. Without such virtues, a world with outrage is inevitable.
Furthermore, most of the US isn't religious anymore. These values and maxims mentioned above are not taught to people anymore, at least not to the degree that they were in the past.
A piece of this should be better training in the home for kids on how to understand the internet. To avoid being hateful and to question things. But so many kids are left to their own devices without parental oversight on this subject. I've even heard the call recently that parents want high schools and colleges to start teaching courses on how to avoid harmful content and misinformation online.
In what feels like ancient history, this used to be the parent's job, before both spouses were working full time.
Our kids and the younger generation suffer from lacking parental instruction on this.
It's very "Lord of the Flies", isn't it?
Let's not underestimate the degree to which 'likes' (social affirmation ersatz) are eliciting the worst in people.
We all get likes. Sometimes they're called upvotes. Sometimes they're called replies. Sometimes they're cumulatively seen as our status in the social pecking order.
Facebook doesn't add anything truly new or transformative here. These problems and patterns are ancient.
It's unfortunate that when you build a product so close to the ground of human communication and human nature you're never going to be able to get everything right, and you're no longer solving technology problems alone but trying to basically combat basic human moral failing itself. We don't ask that of the telephone company.
^ That being said, we can only excuse some of their failures with the above line of thinking. Others we can blame on greed or recklessness, or ignoring the social costs of something like ML recommenders optimizing for engagement. Not sure if those things deserve to be called evil, but I'd still hold back personally. Misguided, overcome by greed, or reckless, perhaps.
The "angry facebook" experience to me seems like the moms against heavy metal / twisted sister case: People are seeing a reflection of what their peers share.
If their circles are angry and share disinformation, that's what they will see.
It is about the circles.
When will this “just luck” characterization of Zuck die? His entire company was certain they should sell for $1B, and most executives resigned when he didn’t. He maneuvered control of the majority of voting shares, how many other founders have done that? Instagram and WhatsApp were genius acquisitions everybody at the time clamored were too overpriced. Even Oculus has turned out to be the leading VR platform. All of the people close to him attest to his extreme intelligence.
Whether malicious or not, Zuck didn’t just “aw shucks I got lucky” into the majority owner of a $1T company, cmon…
Except they are just playing around with the outrage algorithms, the problem is created by Facebook, not some natural occurence. If they wanted to "fix" anything they would make their algorithmic timelines opt-in, or at least an option, for starters.
It is of course very much in the interest of the people working at Facebook to make this seem like a problem that is just there and that it is some "difficult to solve", that "moderation doesn't scale" etc.. These are deflections to make everyone ignore that Facebooks tampering is where it starts.
I know YouTube’s just recommends based on what you just watched/search (you can disable this aspect by clearing or disabling your histories), channels you have subscribed to, (I believe) videos you have “Like” or commented on, and videos you have marked as “Not interested -> I do not like this video”.
Is Facebook’s as “viewer driven”? Or does it recommend based other criteria? e.g. like what’s generally popular.
however, no matter how capable and ethically sound they are, the incentives are forever misaligned with the profit models for both, and adtech over all, as it currently stands. truly good people can chase money and hope to do good things in the process. it's as easy as this.
the writing was on the wall when alex stamos, by all measures the best example of the type of person you're referring to and FB's chief security officer... left. started in 2015 and was out of there by 2018. not many c-levels walk away from a job like that for the reasons he did, and when they do that should be the even to pay attention to (looking at you, sheryl "lean in" sandberg). this was the marker event if people were looking.
If by "established" you mean that it's well known, then yes, you're right. If instead you mean that it's agreed-upon or widely accepted, you'd be wrong. There's a lot of great debate / critique, both about how well the phrase actually applied to Adolf Eichmann himself (Arendt was famously only at the trial for like 5 days), and whether evil in general is ever, in fact, all that banal. Sadly the conversation around "the banality of evil" hasn't received a fraction of the attention that the phrase itself has.
Besides David Cesarani's "Becoming Eichmann" book from the mid 2000s where he stated Arendt had "only saw Eichmann in action for four days", are there any other references that support this? I've not been able to find any. Also the "in action" in that context specifically refers to Eichmann's testimony not that amount of time Arendt spent in the court room. I'm not sure how "famous" this is. Elsewhere her correspondance with her former teacher Karl Japsers indicates she was there for 10 weeks. That would be about a third of the 8 month trial.
Banality of evil is about how ordinary people can work on evil things while not being sociopaths and still being considered ordinary people. But it also presumes that there is some truly evil / sociopathic force driving this through authority, such as Hitler himself in case of Eichmann.
On the other hand the parent poster is saying that Facebook is simply too big to not end up evil, that evil is an emergent property of the million different processes that is Facebook. That view absolves not only regular workers of Facebook who are helping the company achieve evil things, but also the people who are actually in control of the company – Mark Zuckerberg and his senior executive team.
Personally I'm not buying either of these absolutions, but especially not the grand universal absolution that the parent poster affords to the whole company.
Ultimately it is someone's decision to put profits above everything else. Engagement doesn't excessively optimize itself. Users' contact books aren't getting stolen by themselves. Shadow profiles don't fill up themselves. "Just doing my job" is a choice, not an excuse. Many people are complicit in making and implementing these decisions for their own benefit, and they are all responsible for the outcome.
There are some amazing people on their safety and moderation teams. They're also fighting marketing algorithms, I'm sure.
It's essentially Arendt, a Jewish exile from Berlin who fled the holocaust, wrestling with her realization that Eichmann, who reported to Hitler and organized major portions of the holocaust, wasn't a psychopath, but a completely mundane and thoughtless career focused bureaucrat who was trying to rise in government and believed in doing what you are told, who then organized one of the most evil acts in human history without reflecting on what he was doing.
A lot of people that work at slaughterhouses do so because they have no other choice. It is the best opportunity that's afforded to them. It is a job that causes trauma for many, often has long, grueling hours, and doesn't pay well.
Working at Facebook couldn't be further from that situation. Never mind the obvious perks (the tech, the white collar work, the gourmet food, I hear there's also a wood shop where you can go do woodworking on your break, the half a million dollar salary, etc etc etc). But the overwhelming majority of these people have the whole world of job opportunities to choose from, if they're willing to take a pay cut from an INSANELY HIGH salary to just a VERY HIGH salary.
So in that sense, they couldn't be further away from working at a slaughterhouse. The fact is, they could quite literally work anywhere else (any other company or any other city/country with remote work now), and they choose not to. It's not desperation but the textbook case of golden handcuffs.
It's very, very difficult to say no to 500k a year. I'm not even sure I could say no if I were in that position. I'd probably tell myself "Just coast for two more years and both my kids won't have to pay for college" or something like that, and keep going.
Don't fall for words!
Frances Haugen was able to see the big picture. The documents she presented had Facebook employees mentioning it. Facebook didn't act on what was known. It is not that it wasn't known.
To paraphrase John Roberts - the only way not to do a thing is not to do that thing.
And it's sure seems an intentional part of their fig leaf denial strategy -- viz the recent revelations about human trafficking on fb in arabic [2]. Or armed groups in Ethiopia inciting violence on FB in ways that fb chooses not to monitor because of language issues [2].
A company with 21Q2 revenues of $28.5B can't hire moderators in languages spoken in countries with low costs of living... It reflects a thirst for growth with no thought given to the people affected by their growth.
[1] https://www.reuters.com/article/us-facebook-languages-insigh...
[2] https://www.wsj.com/articles/facebook-drug-cartels-human-tra...
There's also another concept, the reality that people do not actually care as much as we think they do. There's a program every public school in the U.S. has where kids run at each other, at speed, knock each other to the ground with concussions, tear their muscles, break their bones, and have terrible behaviors towards one another. Yet every school still has said program. Parents encourage their kids to join. We just don't care about whats right.
Agree, but I think we should look at guns first then. Invented to kill, and yet we let people mass buy them for fun
Internally at FB, everything looks good, you hit all your OKRs and believe users are better off. Maybe you don't, but you're bonus is huge so you'll put your head down and keep on. Externally, it's an entirely different picture. Connecting people is a comically small issue society needs FB to solve, relative to our need for them not to harm children, or promote extremism, or hide research when testifying to congress.
> so while the individuals involved have good intentions with what they are working on, the sum total of all employees' intentions ends up broken.
I think, honestly, that a huge thing is that when you put together basically the entirety of the internet, and society into a giant conversational feedback loop you're bound to spin out the worst, especially if FB wasn't 100% of the time trying to filter it (which they weren't because its a business and the problems weren't always equally known).
Misinformation that's been around forever... ever play the telephone game in school .. you tell one person a story they tell the next and the next and the next soon that story is no longer factual. Stir all that in with bias and things get even murkier!
This is a generally hard problem but it's as significant now as it was in the aftermath of WWII. I'd say it speaks to the reality of human subjectivity, and it never goes away: I can only wonder if the same will be true of AI, and whether it's possible for a thinking being to really internalize the concept of hard limits to their perception, and build that into their model of the world.
You could say the God concept is a way of trying to internalize the limits to perception: 'something is vastly significant and it's not me, and my understanding does not and cannot encompass it'.
With OR without this concept we as humans are exactly as evil as each other. That's the secret. There isn't a qualitative difference between 'us' and history's great monsters. It's about the choices we've made and how we've acted on them: the rest is rationalization, which we are all subject to in one way or another.
Grappling with this is the Nuremberg moment: the question is 'never mind whether you feel you've been good, what have you done?'
So, what have they done?
I’m not saying they are blameless I just always have a tough time laying all the blame on a couple people.
It’s so big and so organized, they can come up with an idea for a new service or policy they want to implement and it takes roughly two weeks to get all the channels to approve and move forward on the idea. Implementation is different, this is just getting all the approvals from legal, finance, marketing, etc..
They are definitely in a position to make changes quickly should they need to.
Imagine if a company had invented methamphetamine, but the ill effects weren't as readily apparent. Then they built an empire on the belief that the societal benefits of millions of people running around in a seemingly ultra-productive manic state were a godsend to society, and that they had truly changed the world. Then realize that the effects of Facebook are worse than that--it has the opposite effect on productivity, has maybe worse mental health effects, and is nevertheless highly addictive. The reality would never sink in inside that bubble. Worse, the tens of thousands of people whose jobs and wealth depending on tuning said meth to be as addictive as possible are...what? Pawns? Believers? Accomplices? Delusional? Regular people. They are regular people.
https://en.wikipedia.org/wiki/The_Corporation_%282003_film%2...
"The Corporation attempts to compare the way corporations are systematically compelled to behave with what it claims are the DSM-IV's symptoms of psychopathy, e.g., the callous disregard for the feelings of other people, the incapacity to maintain human relationships, the reckless disregard for the safety of others, the deceitfulness (continual lying to deceive for profit), the incapacity to experience guilt, and the failure to conform to social norms and respect the law"
If you can't do what you do in a way that isn't this harmful to the world, then you always have the choice to just stop it.
These are all smart people. They could be working on anything else and be successful at it. But they are scared of change. The money is too good.
I just wish the people working at facebook that are decent, that they would just leave and go work somewhere else.
And that we stop debating whether Zuckerberg is redeemable. He is not. He is a psycho. He is why it escalates this much. He is a monster. Beyond all the lies, he intends the damage he does to the world. Maybe someone bullied him as a child. Maybe he is just not well. I don't know.
I also think the people who make the biggest show of how much they care tend to be the same who don’t actually act in a caring way at all.
No, I’m not surprised at all that FB employees say they really care. And that they do so very convincingly.
My actions can show otherwise. IE: im going to go eat a slice of cake, sit down and watch TV tonight.
My priorities and actions don't appear to be inline and the result I'm going for won't be met.
Who are the people to be bold enough to speak for "everyone". You are definitely not speaking for me. I personally get a lot of value from facebook. I never had any problem with it in any respect. Use it to communicate with my family around the world. Used it to rent my apartment, sell thing on marketplace. I keep in touch with people I know. And have very thoughtful and enlightening political discussions that help me do the right choice who to vote for and stay informed. (The only other place with better discussions is hacker news thought)
https://www.facebook.com/?sk=h_chr
I had to go into my groups settings and unfollow them all individually though:
https://www.facebook.com/groups/feed/
Same for pages:
https://www.facebook.com/pages/?category=liked&ref=bookmarks
I half agree. I do in fact think its ben baked in from the get go, just that there was a period where it was not an obvious pillar; you could in fct do all kinds of essentially innocuous things and accept some surveillance capitalism with awareness of your wn liabilities.
It's now become so much larger and problematic, that the 'emergent property' is that every move adds weight to the need for the firms dismemberment into smaller units, or punishing regulatory limits. And I mean truly brutally, snap-noise making bone-breaking regulations.
"So maybe Zuck is telling the truth here, that they are trying to fix all this."
Nope. He knows if he wants to stay on top, he had t keep doing mpre of what hes done, and that his choices are otherwise to actually adapt, which he will not do.
For instance, contrast Zuckerberg's statement here:
> And if social media were as responsible for polarizing society as some people claim, then why are we seeing polarization increase in the US while it stays flat or declines in many countries with just as heavy use of social media around the world?
With such severe under-resourcing and deprioritization that one person had the literal weight of worldwide election integrity on her shoulders, as revealed more than a year ago: https://www.buzzfeednews.com/article/craigsilverman/facebook...
> The memo is a damning account of Facebook’s failures. It’s the story of Facebook abdicating responsibility for malign activities on its platform that could affect the political fate of nations outside the United States or Western Europe. It's also the story of a junior employee wielding extraordinary moderation powers that affected millions of people without any real institutional support, and the personal torment that followed.
Haugen echoes the same in https://archive.is/tQwE9 :
> She soon grew skeptical that her team could make an impact, she said. Her team had few resources, she said, and she felt the company put growth and user engagement ahead of what it knew through its own research about its platforms’ ill effects.
The fact of the matter is that if Zuckerberg were to say "I'm going to pour our profits into trust and safety and abuse avoidance in order to ensure that our position as a trusted brand is sustainable for generations to come," his high levels of voting control and clear defense to any allegations that this was against long-term shareholder interest would fully make that possible. The fact that quite the opposite has happened should be considered with much more weight than his words in a reactive press statement.
A company is not a democracy.
Indeed, we have probably just seen one of the (former) employees with good intentions struggle to stay true to them.
It is the structural incentives in the system that cause the problems.
So yes, evil and discrimination can be an emergent problem even though no individual intends harm.
Then you might also have bad actors who exploit those structural incentives/weaknesses.
Maybe they are trying, but also maybe they are trying to have their cake and eat it too.
What I mean is that very likely the proper way to fix things would financially hurt FB, which seems it’s something they really don’t want to do.
yea, maybe.. they _are_ cashing in billions in the meanwhile
I have no empathy for them. They bring out the worst in Humanity. They build walled silos of festering hate and anger, all driven by "user engagement", "hours on site" and money.
Just remember Rationality is Bounded, ie there are problems chimps with 6 inch brains cant solve. Its the classic Jurassic Park story, where man says he can control anything. And then realizes he cant. By which time its too late.
This is why the road to hell is paved by "good people who have kids" with their good intentions.
FBs issues did not appear yday.
Like the endless war the issues where there right from the start. So why are we talking about it today? Cuz lots of good people didnt do anything, not because they arent good or skilled, because the problem is too complex for them.
This is where Bounded Rationality helps resolve issues. If the problem is too complex, pick a simpler problem.
This is hard for some chimps to do for various reason. So entertaining them is a recipe for disaster. Their narrative will always be- "people are good. People experienced World War 1. They know whats at stake. They lost family, friends, body parts. Many are great Heroes. Trust them. They know what they are doing". And still we got World War 2.
Why? Cause rationality, skill and experince doesnt matter for some problems. All the "good germans" from politicians, to religious leaders, to military and intelligence leaders knew Hitler had to go long before any notion of war entered the minds. Every coup and assassination they ploted they second guessed themselves. All of them ended up dead.
https://www.buzzfeednews.com/article/ryanmac/growth-at-any-c...
(Note: "Connecting people" here does not mean providing communications services, it means using behind-the-scenes, unconsented, and sometimes deceptive tactics to figure out whether and how people are connected to each other IRL.)
Andrew Bosworth June 18, 2016
The Ugly
We talk about the good and the bad of our work often. I want to talk about the ugly.
We connect people.
That can be good if they make it positive. Maybe someone finds love. Maybe it even saves the life of someone on the brink of suicide.
So we connect more people
That can be bad if they make it negative. Maybe it costs a life by exposing someone to bullies. Maybe someone dies in a terrorist attack coordinated on our tools.
And still we connect people.
The ugly truth is that we believe in connecting people so deeply that anything that allows us to connect more people more often is de facto good. It is perhaps the only area where the metrics do tell the true story as far as we are concerned.
That isn't something we are doing for ourselves. Or for our stock price (ha!). It is literally just what we do. We connect people. Period.
That's why all the work we do in growth is justified. All the questionable contact importing practices. All the subtle language that helps people stay searchable by friends. All of the work we do to bring more communication in. The work we will likely have to do in China some day. All of it.
The natural state of the world is not connected. It is not unified. It is fragmented by borders, languages, and increasingly by different products. The best products don't win. The ones everyone use win.
I know a lot of people don't want to hear this. Most of us have the luxury of working in the warm glow of building products consumers love. But make no mistake, growth tactics are how we got here. If you joined the company because it is doing great work, that's why we get to do that great work. We do have great products but we still wouldn't be half our size without pushing the envelope on growth. Nothing makes Facebook as valuable as having your friends on it, and no product decisions have gotten as many friends on as the ones made in growth. Not photo tagging. Not news feed. Not messenger. Nothing.
In almost all of our work, we have to answer hard questions about what we believe. We have to justify the metrics and make sure they aren't losing out on a bigger picture. But connecting people. That's our imperative. Because that's what we do. We connect people.
When this statement leaked, he made the bullshit claim that he was playing devil's advocate. He certainly wasn't. This post was made at the same time as another leaked one about messenger adding a deceptive interstitial to get people to agree to share their number and contacts with FB.
It seems that the author is operating under the assumption that if everyone is inside of their product, the world won't be fragmented anymore. People will be connected.
Yes. They will be connected. To the product.
We can do better than this dreary future. It is possible to connect people as peers, without the exploiting hands of intermediaries like the executive who wrote this statement.
Though the statement seems well-meaning, etc., it is weaselly and manipulative. It also conveniently doesn't address some of deeper issues from Frances Haugen's testimony.
For example, Haugen focused on the fact that Zuckerberg has created a relatively flat organization, where if decisions help the core metric they must be good, and vice versa. Haugen testified that Zuckerberg was made aware that instituting a newsfeed tweak would entail a) small ding to the core engagement metrics and b) would decrease violence in Ethiopia... He chose the metric over the decreased violence.
There comes a point where blindly pursuing metrics -- be it money or engagement -- without regard to the effects on society are hard if not impossible to distinguish from sociopathic behavior.
Also, let's not forget that researchers and renown statisticians employed by / sponsored by Big Tobacco (e.g. R.A. Fisher) convinced themselves that smoking didn't cause cancer. [0]
- Social media can't cause "polarization" because the measurements of that are going down in most of the world, except the USA. But social media is heavily used everywhere.
- It makes no sense to claim an organization doesn't care about X when it heavily funds research into X.
- If you react to a company researching the harms of its products by leaking everything and publicly accusing the company of being evil, other companies will simply not do research into the harms of its own products.
The second two are just logic. The first would benefit from a citation but I'll take his word for it.
(Quoting from Zuckerberg's original post)
> "And if social media were as responsible for polarizing society as some people claim, then why are we seeing polarization increase in the US while it stays flat or declines in many countries with just as heavy use of social media around the world?"
This certainly needs a citation. Ethnic conflict in Ethiopia, division in Britain around Brexit, and US polarization would seem to be obvious counter examples. It should certainly be said that correlation is not causation. Also, note that the claim that 'social media doesn't cause polarization anywhere / everywhere in the world' is a subtle bait and switch from "Facebook causes polarization in certain areas" or "Facebook's lack of robust, well-staffed safety mechanisms allow it to be exploited to cause polarization in certain areas."
> "If we wanted to ignore research, why would we create an industry-leading research program to understand these important issues in the first place? If we didn't care about fighting harmful content, then why would we employ so many more people dedicated to this than any other company in our space -- even ones larger than us?"
There is more than one way to care about a research program, but absolute amount of budget spent on X is not the same thing as relative budget priority. For a company that made 54 billion in profit last quarter, it'd be more surprising if they had no research program. Zuckerberg does not present any specifics here -- what percentage of gross revenue is the research program? How many people are employed to fight content, and how does this compare to how many people are employed to encourage growth? And what's the point of research if the results are not acted upon? The whistleblower was pretty clear that the research doesn't matter even if suggested fixes will cause a <1% point hit to the core engagement metrics. Does Zuckerberg have any specific facts about how many times civic integrity / safety based suggestions was prioritized over the core metrics, other than the one example he cites (Meaningful Social Interactions)?
Speaking of Meaningful Social Interactions (MSI), the whistleblower specifically said that there is a foundational problem with how MSI is defined, because it includes the number of comments a post receives. Even without intending it, it is easy to see that controversial posts will attract more attention. Zuckerberg cites no evidence about the relative percentage of comments that are angry vs other emotions, and how this has changed.
> "That said, I'm worried about the incentives that are being set here. We have an industry-leading research program so that we can identify important issues and work on them. It's disheartening to see that work taken out of context and used to construct a false narrative that we don't care. If we attack organizations making an effort to study their impact on the world, we're effectively sending the message that it's safer not to look at all, in case you find something that could be held against you."
Zuckerberg is complaining about incentive problems? The whistleblower has said that Facebook's very policies make it "not care" even if individuals do. This is also what comes across in the WSJ articles. In other words: the narrative isn't false, and this has been documented. His point about the specific incentive problem of leaked research is interesting, but it's a case of an abstract concern (for other company's research) vs. very real and well documented harm Facebook is a) doing now, and b) per the whistleblower, is unequipped to solve alone.
Also, at one point in Zuckerberg's missive, he shifts the locus of responsibility from Facebook to Congress: "..at some level the right body to assess tradeoffs between social equities is our democratically elected Congress. For example, what is the right age for teens to be able to use internet services?" Deciding what the "right" age is can take several forms. A panel of seasoned jurists, child psychologists, policy experts, etc., can spend a long time debating what the "right" age is in the universal sense. Or, Facebook could take stand, err on the side of caution, and say that 17 is a better age than 13, and detail why they think so.
1. Some people disagree fundamentally over the nature of government and how power should function.
2. Some people were afraid of various kinds of "punishment" or instability that they were told leaving would cause, even if they would have supported it in the abstract.
Neither of these have anything to do with messaging apps or social media. As for ethnic conflict in Ethiopia - ?!?! - seriously?! That part of Africa has been a hotbed of bloody tribal conflict for my entire life. It's driven by the local culture, I seriously doubt anyone there gives the tiniest shit what people post on Facebook.
This is Mark's point. It's not a bait and switch to point out fundamental inconsistencies between other people's theories and the wider world. The idea that Facebook is some unique social evil that causes people to disagree just looks very odd from outside the USA, looking in. It's being made a scapegoat for US social problems. Everywhere else when people fight, they are well aware what they're fighting about and why.
Re: research. You seem to be arguing that yes, they spend a lot of money on this issue but it's not enough, whilst also admitting you don't know how much they spend. You're just convinced it's too low. But this is meaningless: research programs have natural costs and you can't simply double a budget and get ... what? Conclusions that are twice as "good"? Same conclusions twice as fast? It doesn't work like that.
Nor is research guaranteed to result in actionable outcomes. Look at their conclusions around Instagram. Some teenage girls said it made them feel worse, but more said it made them feel better. What's the actionable outcome here? Unless there was an incredibly specific kind of thing the girls who felt worse were seeing, there probably isn't any plausible action, and if there was some sort of specific content that made people feel bad, removing it would just be used as further proof of their guilt: they're manipulating the feed to increase engagement!
The rest of this thread is all like that. You start with take that is itself controversial and extreme, like "people talking about controversial topics is inherently bad and Facebook should suppress it". Then when Facebook pushes back and points out that actually, lots of people like talking to each other, including about politics, they are cast as villains.
This has all the trappings of a purity spiral. No matter how much effort Facebook makes, it's never considered to be enough. Activists who aren't quite sure what they're trying to fight or why, insist on ever more moderation in the hope that somehow this will cause other Americans to all start agreeing with them. The result is stuff like XCheck, an unstable downward spiral in which ever more aggressive moderation policies force ever more people to be exempted from them, lest the incoherency becomes too obvious.
One of the points I'm making is that Zuckerberg's statement lacks specifics in the form of numbers and data. I think it'd be interesting to read a point-by-point rhetorical analysis of his statement.
Also, because of this, yes, I don't know how much Facebook spends on research. I agree that though money and research quality are quite likely correlated, it's very hard to say by how much. That being said, I care a whole lot more about the values of the company. Haugen's testimony paints a textbook picture of a values problem. The whistleblower has repeatedly said, under oath, that Facebook understaffs its security and safety teams, and that they turned off the safety and integrity protections after the election, and more.
It's also true that civic divisions in the US -- not to mention other social problems -- run much deeper than Facebook. One mechanism people like me are concerned about is how users are recommended people to follow or content that results in either more division or them being led to a more extreme version of their views. In her testimony, Haugen gave the example of how indicating an interest in healthier eating on IG can lead recommendations of anorexia / eating disorder content. Saying that Facebook's engagement-based-ranking has nothing to do with promoting civil divisions seems to me like saying that the Youtube recommendation algorithm a few years back had nothing to do with the rise of the modern flat earth movement. Researchers have evidence that it did [0].
As for ethnic conflict in Ethiopia, I only bring it up because of Haugen's testimony. As this Guardian article puts it, "Haugen warned that Facebook was 'literally fanning ethnic violence' in places such as Ethiopia because it was not policing its service adequately outside the US." [1]. Your comment does make me wonder how many people in Ethiopia have access to the internet though.
This is a slight tangent, but it's also worth mentioning that re: IG and mental health... we don't know about other research, like about any further attempts at a causal study -- most of what's been cited is correlational and comes from small sample-sized interviews. So it would be nice to see larger and more rigorous studies. I don't believe that research should stop with question "Is Instagram Harmful." Of course that's going to have a mixed answer when dealing with large masses of people. "Who is susceptible to being harmed?", "By what mechanisms is IG harmful to some people?" etc. are questions that need answers.
I also disagree that people are so biased against FB/IG that anything they do will be seen in a bad light. Were they to tweak the IG recommendation algorithm so that an interest in healthier eating did not lead to anorexia content, people like myself would applaud. And though I am not an activist, I'm generally interested in (the enabling of) wholesome discussions and interactions, i.e. things that promote a feeling of being in a community / society rather than feeling apart from it.
[0] https://www.theguardian.com/science/2019/feb/17/study-blames... [1] https://www.theguardian.com/technology/2021/oct/07/facebooks...
Arguing that Facebook causes tribal conflict in Ethiopia by not "policing aggressively enough" or "understaffing" teams is not, to me, the argument of a whistleblower. It's the argument of someone who has totally lost perspective, of a totalitarian who believes that any and all of humanities ills can be fixed by manipulating communication platforms. It's no different to saying "if the phone company cuts off any phone call in which people are arguing, there will be no more arguments and everyone will be happy". When phrased in terms of slightly older-gen tech it is obviously absurd.
"Were they to tweak the IG recommendation algorithm so that an interest in healthier eating did not lead to anorexia content, people like myself would applaud"
Good on you for being consistent then! Sadly it seems to be very rare. Look at Zuck's post. He points out that Facebook did in fact make changes to prioritize stories from friends and family, even though that reduced their income and reduced the amount people used the site i.e. a lot of users were actually people who don't care much about their cousin's cat pictures, but do care a lot about civics, or phrased another way, "divisive politics".
Yet it doesn't seem to have done them any good. For people like Haugen and a depressing number of HN posters it's not enough to re-rank nice safe family stories about new babies. For them Facebook also has to solve teenage depression, war in Africa and probably world hunger whilst they're at it. And if they aren't it's because they're "under-staffing" or refusing to "adequately police" things.
The metaphor of a phone company cutting off an argument is an interesting one. I agree that people arguing is a fact of society / nature, and I also agree that cutting off a phone call seems like an absurd way to try and solve the larger problem. But at the same time, I don't think the metaphor fully applies, for the following reasons:
First, a phone call is a one-to-one communication, and Facebook is one-to-many. It's rare if not unheard of for strangers to call each other and say what they think about, for example, a NYT article. Second, there is no recommendation system pushing "engaging" subjects, where engagement can be defined in terms of how controversial it is. Third, only 9% of FB users speak english, and Haugen testified that the non-english safety features, tweaks to the ranking algorithm, and tooling are not as good (potentially drastically worse?) in non-english languages.
Most people would argue that phone companies have some responsibility to prevent spam calls, similar to how an email services prevent or flag spam emails. These are network level actions, and a lot of Haugen's testimony was about how FB was being irresponsible in this regard.
The best I can come up with is that Facebook is so big that the "evil" is an emergent property of all the different things that are happening. It's so big no one can comprehend the big picture of it all, so while the individuals involved have good intentions with what they are working on, the sum total of all employees' intentions ends up broken.
So maybe Zuck is telling the truth here, that they are trying to fix all this. But no one can see the forrest from the trees.
I can't reconcile it any other way.