News for hackers. Stuff that matters.
Re:Facebook deliberately made people sad. This ought to be t... by antiterra on Saturday April 17, 2021 @04:24PM (#26847156)
Product Person #1: Hey, here’s a writeup that says if we show too many positive posts to people that it creates bad feelings. Should we show less positive posts?

Product Person #2: Not sure, wouldn’t negative posts make people feel worse?

Product Person #1: Wow, I donno, maybe we should try adjusting additional posts people see one way a bit and see what happens?

Product Person #2: Not a bad idea, how about we try both? You know, an A/B test.

Product Person #1: Hmmm. Ok, but— when we’re done, let’s have some scientific review of our data just so that we can correct the record and push along the science around this stuff.

Journalist: This company deliberately made people sad

Re:Facebook deliberately made people sad. This ought to be t... by thatcat on Saturday April 17, 2021 @05:09PM (#26847473)
That's the definition of an unethical experiment design and would be considered academic misconduct if that were academic work. Regardless of intent, fb probably shouldn't be allowing front end devs to design psychological experiments at mass scale.

https://psychology.wikia.org/wiki/Experimental_ethics

Re:Facebook deliberately made people sad. This ought to be t... by graeme on Saturday April 17, 2021 @05:43PM (#26847692)
Doesn’t that suggest professional ethics are immoral? They block a temporary, one off experiment which could suggest how to avoid sadness.

The alternative is relying on intuition only and possibly making people permanently sadder. Or is there a way to achieve this knowledge consistent with the field of research ethics?

We saw this with challenge trials in the pandemic where ethicists fretted people would reject them and concluded challenge trials are immoral. Meanwhile opinion polls suggest people view challenge trials as virtuous and the current method of waiting for infections as immoral.

Re:Facebook deliberately made people sad. This ought to be t... by seattledev on Saturday April 17, 2021 @07:00PM (#26848197)
Yes, there is a way. You left them specifically opt in to it, you provide them disclosure documents of what's being tested, and you provide free access to mental health resources.
Re:Facebook deliberately made people sad. This ought to be t... by ARehmat on Saturday April 17, 2021 @08:12PM (#26848611)
It would be interesting to find out if these experiments lead to any suicides etc. Although I suppose that Facebook is not interested in releasing that type of information.
Re:Facebook deliberately made people sad. This ought to be t... by zwkrt on Saturday April 17, 2021 @09:14PM (#26848930)
Which drop of rain caused the dam to break? In the book Good Omens there is a demon who considered himself the best not because he was the best deceiver or torturer, but because of his ability to cause mass malcontent.

The real evil isn’t in the experiment, it’s that the researchers found that Facebook makes people’s lives worse. How many suicides are caused by Facebook’s investors? Whether they can mitigate it this way or that is splitting hairs.

Re:Facebook deliberately made people sad. This ought to be t... by thatcat on Sunday April 18, 2021 @12:59AM (#26849932)
Isn't every experiment temporary one off? Ethics are strict bc of the dark history of human experimentation.
Re:Facebook deliberately made people sad. This ought to be t... by TomSwirly on Sunday April 18, 2021 @10:36AM (#26852838)
> Doesn’t that suggest professional ethics are immoral? They block a temporary, one off experiment which could suggest how to avoid sadness.

NO, companies should not perform secret psychological experiments on people without their consent because they "could suggest how to avoid sadness."

> challenge trials in the pandemic

You mean the ones people consented to? Why is consent not an issue for you?

Re:Facebook deliberately made people sad. This ought to be t... by mgraczyk on Saturday April 17, 2021 @05:51PM (#26847751)
Which part of this conception of experimental ethics does this violate? Facebook's experiment did not directly cause the emotions, the posted content for that. Even if it did, this sort of thing is well within the bounds of normal experimentation with large systems.

This is similar to claiming that traffic experiments which change the flow of cars, in term causing some people to experience more traffic and become unhappy, are unethical. Do you think traffic experiments are unethical?

Re:Facebook deliberately made people sad. This ought to be t... by xg15 on Saturday April 17, 2021 @07:59PM (#26848537)
> Facebook's experiment did not directly cause the emotions, the posted content for that.

Facebook definitely caused the emotions - by deliberately choosing to show particular content.

> This is similar to claiming that traffic experiments which change the flow of cars, in term causing some people to experience more traffic and become unhappy, are unethical. Do you think traffic experiments are unethical?

If the objective of the traffic experiment had been to deliberately get a certain group of cars stuck in a traffic jam, this would absolutely be unethical.

Re:Facebook deliberately made people sad. This ought to be t... by vickychijwani on Sunday April 18, 2021 @12:07AM (#26849722)
> If the objective of the traffic experiment had been to deliberately get a certain group of cars stuck in a traffic jam, this would absolutely be unethical.

A closer analogue would be a traffic experiment designed to gauge the emotional effects of a particular route. That's an important difference.

The article itself says the experiment was designed to look for evidence of emotional contagion, which is quite different from "it was designed to make people sad".

Also, in another thread it's pointed out that the effect sizes from this study were extremely small - something like 0.3% more negative words were used by ~150k people. The effect is said to be on the same scale as any minor UI change, like a size/color change of the "like" button. So it's hard to see this as anything other than folks looking for a reason to get outraged.

Re:Facebook deliberately made people sad. This ought to be t... by xg15 on Sunday April 18, 2021 @09:50AM (#26852456)
> The article itself says the experiment was designed to look for evidence of emotional contagion, which is quite different from "it was designed to make people sad".

That was their research goal, yes. Their methodology was this:

> For some, that meant 90% of all "positive" posts were removed from their newsfeed for a week, rendering the social network a pit of despair.

Research can be unethical even if the intention of the research is not.

For the traffic analogy, if part of that traffic experiment would involve a routing change that researchers know will likely cause a traffic jam, then the experiment will be unethical, no matter how warranted the research may be.

That's the reason you cannot use placebos to test life-saving medication (without prior informed consent), even though it would certainly be beneficial for science if you could.

And in Facebook's case, their research goal wasn't even that ethical in the first place. Maye we can have this talk if they try to find a cure for depression through emotional manipulation, but this was literally just about preventing people from leaving Facebook:

> "At the same time, we were concerned that exposure to friends' negativity might lead people to avoid visiting Facebook."

Re:Facebook deliberately made people sad. This ought to be t... by thatcat on Saturday April 17, 2021 @08:33PM (#26848724)
Requirement for a clear research protocol statement from the outset, including clear timetable and detailed procedures.

Protection of clinical trial subjects

Clinical trials on minors

Clinical trials on incapacitated adults not able to give informed legal

Establishment of mandatory Ethics Committees

Re:Facebook deliberately made people sad. This ought to be t... by seattledev on Saturday April 17, 2021 @06:57PM (#26848179)
I disagree. If facebook is testing content like this then they explicitly know which content makes people sad. To manipulate someone's feed to push them stuff that knowingly makes them sad for the purpose of experimenting with someone's emotions, that is highly unethical to me.

There is a massive difference in studying and directing traffic to help make traffic flow better. The goal there is to improve driving for everyone. Facebook's goal is to intentionally make people unhappy for the sole purpose of making more money.

Re:Facebook deliberately made people sad. This ought to be t... by unethical_ban on Saturday April 17, 2021 @05:45PM (#26847701)
How would it have been ethical?

If their current process was already suspected to be the worse of the two, and their goal was to improve peoples' moods per se, what is the ethical thing to do? Keep people feeling more sad?

Or, perhaps, stop being algorithmic in what people see, or else put people in full control of simple sorting (prioritize my "starred" category and sort by date)?

Re:Facebook deliberately made people sad. This ought to be t... by slver on Sunday April 18, 2021 @03:05AM (#26850411)
Maybe it's unethical in academic context, but in public service context, you have an existing service, and you're in charge of improving it.

When you have an improved algorithm, would you change your algorithm all at once for everybody, or would you test your change on small % of users, before you go full-scale? You'd do the latter. There's no better option. Because if you're wrong, your impact is much more devastating.

In other words, there's always an algorithm filtering your feed. If that was unethical, it makes Facebook unethical by merely existing.

Re:Facebook deliberately made people sad. This ought to be t... by TomSwirly on Sunday April 18, 2021 @10:37AM (#26852850)
> in public service context

This is not a "public service" - it's a for-profit company.

> When you have an improved algorithm,

This is not an "improved algorithm". They deliberately removed almost all positive news from some people's feeds for a week.

Re:Facebook deliberately made people sad. This ought to be t... by slver on Sunday April 18, 2021 @11:37AM (#26853376)
I meant public service as in it's a service, and it's providing itself to the public. Not as in government service.
Re:Facebook deliberately made people sad. This ought to be t... by plaidfuji on Saturday April 17, 2021 @05:34PM (#26847640)
To be fair, the article states that the study was designed by a data scientist. Not that that implies that any additional ethical considerations were taken into account.
Re:Facebook deliberately made people sad. This ought to be t... by seattledev on Saturday April 17, 2021 @07:02PM (#26848209)
Data scientist means someone who's had classes in stats and knows how to use software to analyze data. They don't cover how to run experiment and don't cover ethics
Re:Facebook deliberately made people sad. This ought to be t... by urthor on Saturday April 17, 2021 @09:06PM (#26848888)
To be fair, the profile of a data scientist at a F500 non tech company and at a company like FB is slightly different. Facebook's data science crew is known for being heavier on the stats lighter on the software (relatively speaking) and probably can design a good experiment.

That said, anyone who signs up for a job at Facebook doesn't give a shit about ethical design of experiments.

Re:Facebook deliberately made people sad. This ought to be t... by mgraczyk on Saturday April 17, 2021 @09:16PM (#26848943)
Hi, I used to work on ML and ran experiments like this one at FB. Just want to point out that the effect of experiments like this on an individual is smaller than the effect of making the app start 0.1 seconds faster, or retraining the network used to filter hate speech. The only reason the effect is significant is because N>650k, so tiny effect sizes can be detected.
Re:Facebook deliberately made people sad. This ought to be t... by thatcat on Sunday April 18, 2021 @01:13AM (#26849973)
whats the variance on that effect?? doesn't a large data set like that just lead to type ii errors?
Re:Facebook deliberately made people sad. This ought to be t... by shadowgovt on Saturday April 17, 2021 @05:51PM (#26847747)
Believe it or not, they didn't have the front end devs design it.

There was a specific task force at Facebook intended to better understand customer psychology. Came from them.

Re:Facebook deliberately made people sad. This ought to be t... by typon on Saturday April 17, 2021 @05:36PM (#26847648)
The constant derision of journalists in tech circles (especially on HN) is kind of shocking to see. Did you read the article or did you miss that the journalist is relaying fellow researchers' apprehensiveness about Facebook being allowed to conduct an unethical study. This article [1] is linked in the second paragraph.

[1] https://www.theguardian.com/technology/2014/jun/30/facebook-...

Re:Facebook deliberately made people sad. This ought to be t... by hn_throwaway_99 on Saturday April 17, 2021 @05:42PM (#26847684)
It's nothing personal against journalists, but the economics of the business mean that they have huge incentives to make things seem more outrageous or nefarious than they actually are.

I did read the whole article, and that doesn't excuse the BS clickbait title of "Facebook deliberately made people sad."

I find the fact that the article is complaining about emotional manipulation by Facebook, while using a deliberately manipulative title, to be more than a tad ironic.

Re:Facebook deliberately made people sad. This ought to be t... by threatofrain on Sunday April 18, 2021 @03:39AM (#26850579)
Do journalists even write the titles to their own articles? I'm sure every newsroom has their own distinct culture, but this sounds like an editor's job.
Re:Facebook deliberately made people sad. This ought to be t... by antiterra on Saturday April 17, 2021 @05:46PM (#26847711)
The commentary is more on the clickbait title, which very likely could have been written by someone other than the article’s author. (NB: journalists do A/B testing to pick the title that incites the most clicks from outrage[1].)

Further, the article you link appears to have commentary by a single researcher.

Here’s a writeup by researcher who thinks it wasn’t unethical at all and that it would have passed IRB as performed. It, of course, does not end the discussion, but it does demonstrate that the issue is more complex than a company deliberately making people sad:

https://hbr.org/2014/07/were-okcupids-and-facebooks-experime...

[1] https://www.washingtonpost.com/lifestyle/media/media-values-...

Re:Facebook deliberately made people sad. This ought to be t... by smsm42 on Saturday April 17, 2021 @08:32PM (#26848716)
I don't know why it's shocking. The quality of the work in press has been going downhill for years, and journalists routinely misunderstand and misinterpret things they report about - sometimes innocently through ignorance and incuriosity, sometimes maliciously to push an agenda. It is, of course, not limited to tech - but tech is also not excluded from this global trend. Is it reasonable to expect from tech circles to ignore it?

And "the journalist is relaying" is a poor excuse - the journalist has a choice of what to relay and how to frame it, and this choice is routinely used to frame things in a specific way. There's no "just reporting" anymore, if there ever was. There's always a reason why something is reported (or not reported, as it happens) and there's always a reason why something is reported in a specific way. The choice and control is always on the press's side.

Re:Facebook deliberately made people sad. This ought to be t... by rendall on Saturday April 17, 2021 @05:45PM (#26847702)
Questioning whether someone read the article is against the guidelines:

> "Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that.""

https://news.ycombinator.com/newsguidelines.html

Re:Facebook deliberately made people sad. This ought to be t... by chatmasta on Saturday April 17, 2021 @04:25PM (#26847173)
I admit I didn’t read the article because I thought I knew the event it was referring to, but didn’t Facebook actually publish this as a psychology study? i.e. they didn’t just use it for A/B testing features but actually thought they were doing something “good” to the point of publishing a study about it. It’s laughable now lol.
Re:Facebook deliberately made people sad. This ought to be t... by cryptoz on Saturday April 17, 2021 @04:28PM (#26847184)
Yes, they published the paper and publicly bragged about how successful they were in making hundreds of thousands of people feel sad.

https://www.pnas.org/content/pnas/111/24/8788.full.pdf

Edit: And it is in their public defense of this paper that they think we all gave 'informed consent' to this kind of psychological manipulation when we signed up for Facebook because it's in the TOS.

They literally define 'informed consent' as the legal text in their TOS. I mean that's insane, they know their users don't read that before signing up. It's not f'ing informed or consent ugh this makes me so mad.

Also what kind of sick company puts into their TOS that they can emotionally manipulate you on purpose whenever they want? Fucked up.

Re:Facebook deliberately made people sad. This ought to be t... by wpietri on Saturday April 17, 2021 @04:42PM (#26847286)
Agreed. If people end up surprised about what they nominally consented to, it's not informed consent. Another example of Facebook's "move fast and break people" ethos.
Re:Facebook deliberately made people sad. This ought to be t... by tshaddox on Saturday April 17, 2021 @05:19PM (#26847546)
It seems like you’re implying that, by explaining in slightly more detail how this might have happened, you somehow show that the journalist was oversimplifying or distorting things. But, no, your last sentence is definitely still correct.
Re:Facebook deliberately made people sad. This ought to be t... by Graffur on Saturday April 17, 2021 @05:38PM (#26847666)
Why did you make this comment? Is it what you believe happened?
Re:Facebook deliberately made people sad. This ought to be t... by mhh__ on Saturday April 17, 2021 @05:16PM (#26847527)
> This company deliberately made people sad

Which would be correct, surely?

Re:Facebook deliberately made people sad. This ought to be t... by Aunche on Saturday April 17, 2021 @05:25PM (#26847587)
It's technically correct but implies malicious intent. It's like saying "Pfizer deliberately injected a substance in people that kills them" to describe a failed drug trial.
Re:Facebook deliberately made people sad. This ought to be t... by dheera on Saturday April 17, 2021 @05:29PM (#26847607)
"it creates bad feelings"

If this is the hypothesis they are testing for, the problem is they subjected people to a psychological experiment without consenting to it, for the ultimate purpose of their own financial gain.

How is that not malicious intent?

Re:Facebook deliberately made people sad. This ought to be t... by eptcyka on Saturday April 17, 2021 @05:37PM (#26847655)
If you dislike a _b_ version of an a/b tested site to the point that you feel deeply dissappinted by it, were the people who designed the experiment operating with a malicious intent?

I don't think facebook engineers or data scientists care what people feel when they're adjusting their models, they only care about time spent on their platform or some other overly reductionist metric. One could argue that chasing super-efficiency will always result in abominations, but I think its hard to say that someone is doing something imoral by just doing the human equivalent of gradient descent in the optimization problem of driving engagement. That's not to say that we shouldn't have a conversation about this and not figure out ways to make these super efficient and powerful companies find ways to be satisfied with organic engagement.

Re:Facebook deliberately made people sad. This ought to be t... by dheera on Saturday April 17, 2021 @06:05PM (#26847844)
There's a difference between disappointment about a product (which is fine) and doing an experiment to test that might knowingly create bad feelings in someone's life in one cohort of your experiment.

What if an almost-suicidal person got the "b" version?

A/B testing should be used when you think, in good faith, that BOTH "a" and "b" versions could be good and want to know which one works better, not to confirm a hypothesis that "b" has a negative impact on users' personal lives.

Re:Facebook deliberately made people sad. This ought to be t... by Aunche on Saturday April 17, 2021 @05:39PM (#26847673)
Surely, people understand that Facebook makes changes to their website, and that these changes are based on data. That is all an experiment is. If Facebook wasn't allowed to experiment, they would never be allowed to change their interface or recommendation engine at all.
Re:Facebook deliberately made people sad. This ought to be t... by dheera on Saturday April 17, 2021 @06:07PM (#26847851)
There's a difference between experimenting on the product, and conducting an experiment that deliberately puts one cohort of users in an environment hypothesized to create negative emotions.

A/B tests for the case where you honestly, in good faith, think both A or B could be good designs, but you don't know which one is better.

A/B testing is for product design changes, not psychology experiments. It is NOT for the primary intention of a psychology experiment with a group of subjects that didn't consent to a study, where either A or B has a suspected negative impact on emotions, and you're using A/B testing to confirm or deny that hypothesis.

Re:Facebook deliberately made people sad. This ought to be t... by Aunche on Saturday April 17, 2021 @06:38PM (#26848062)
It's still a product decision though, especially the way the top comment frames it. It's just one that happens to be centered around emotional language. I suspect that an experiment that deals with more or less political content would have a similar effect on people's mental state.
Re:Facebook deliberately made people sad. This ought to be t... by detaro on Saturday April 17, 2021 @05:43PM (#26847693)
Guess why you need to opt in to a drug trial.
Re:Facebook deliberately made people sad. This ought to be t... by moron4hire on Saturday April 17, 2021 @05:30PM (#26847612)
Except people have to give consent for drug trials
Re:Facebook deliberately made people sad. This ought to be t... by kennywinker on Saturday April 17, 2021 @05:51PM (#26847749)
Not just consent! informed consent.
Re:Facebook deliberately made people sad. This ought to be t... by antiterra on Saturday April 17, 2021 @05:19PM (#26847550)
Would you consider ‘this company deliberately made people happy’ to also be correct, then?