News for hackers. Stuff that matters.
Re:Facebook Incubated the Insurrection by nr2x on Thursday January 14, 2021 @09:23AM (#25776553)
Somebody from Facebook recently told me they developed the best system to flag radical/violent content in the world, I pointed out they first developed the best system to spread it.
Re:Facebook Incubated the Insurrection by mrweasel on Thursday January 14, 2021 @09:34AM (#25776718)
What makes Facebook worse, in my mind, is that people don't seem to care that it's their real name associated with terrible radical, violent and angry comment. At least on something like 4Chan you'd be anonymous, but nope, people will write the most grotesque comments, while everyone can see their real name, where they live and who they work for. Some people don't seem to care, and that's pretty scary.
Re:Facebook Incubated the Insurrection by newsbinator on Thursday January 14, 2021 @09:41AM (#25776806)
> people don't seem to care that it's their real name associated with terrible radical, violent and angry comment

They don't realize their comment is terrible or radical. To them it seems perfectly rational to be this angry or to respond to "attacks" with violence of their own.

They think they are voices of reason in a world that's losing its mind.

If you're a brave hero in an unjust world, why not use your real name?

Re:Facebook Incubated the Insurrection by JumpCrisscross on Thursday January 14, 2021 @09:37AM (#25776751)
> people don't seem to care that it's their real name associated with terrible radical, violent and angry comment

The hypothesis of real name policies was that people would be civil online if their real-world identities grounded them. In reality, the tail wagged the dog.

Re:Facebook Incubated the Insurrection by dragontamer on Thursday January 14, 2021 @01:43PM (#25780338)
Yeah, but anyone who knew a thing about Usenet back in the day knows that was false.

I mean, it was a theory that was popular in the 00s, mostly because a ton of people at that time didn't have experience with Usenet.

But a lot of vile language was used in the clear, signed with the real names of many individuals. Anonymity doesn't seem to change much. Humans will be humans, whether or not they're anonymous.

Re:Facebook Incubated the Insurrection by coffeefirst on Thursday January 14, 2021 @10:10AM (#25777171)
Yeah, it may have worked in some contexts, but people also read the room. And when the algorithm is setting the room to "1 tick more extreme than you" they gradually dial up.

I've watched this process turn friends who had pretty mild political leanings to "burn it all down" radicals or transform into right wing talk radio hosts. It's not good.

Re:Facebook Incubated the Insurrection by brlewis on Friday January 15, 2021 @02:21PM (#25795043)
Was that the hypothesis, or just the marketing? Obviously real names make it easier to integrate marketing data from disparate sources.
Re:Facebook Incubated the Insurrection by nr2x on Thursday January 14, 2021 @09:42AM (#25776810)
Very astute observation.
Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @09:55AM (#25776991)
One key takeaway from 1/6 is that a sizable chunk of the mob had no idea that they were doing anything wrong, and are surprised to find themselves in handcuffs after the fact.

At least most historical revolutionaries had the self awareness to understand that trying to overthrow the state is super illegal, and maybe a bit of clandestine-ness is in their own best interest.

Re:Facebook Incubated the Insurrection by waylandsmithers on Thursday January 14, 2021 @11:08AM (#25778043)
I'm not sure self awareness is the best way to put it though if they thought they had the blessing and encouragement of the sitting president. That's what makes this hard to compare to most of the revolutionary uprisings of the past.
Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @03:29PM (#25782046)
We could probably quibble on the precise definition of “revolution”[0], but it sure wouldn’t be the first time one part of a government has riled up a mob to attack another part of the government. The results are usually what you’d enthusiastically call “not a good time”. Seeing the executive attack the legislature with a mob is unusual though, as usually the executive leverages their control of the military in these sorts of self-coups.

0 - While I would argue that installing trump for a second term would constitute a revolution, it’s an interesting question whether or not the rioters saw themselves as revolutionary. Calling 1/6 the new 1776 certainly implies yes, but a lot of them seem to think that they were actually a pro-constitution group there to undo a coup done by “the deep state”. Long story short, it’s complicated.

Re:Facebook Incubated the Insurrection by rsynnott on Thursday January 14, 2021 @01:39PM (#25780293)
I mean, even if they had a signed letter from Trump saying "this is bigly good, do this" that doesn't stop it from being super-illegal. He's not a dictator; he can't just give people license to do illegal things. As they should know very well.
Re:Facebook Incubated the Insurrection by Tarsul on Thursday January 14, 2021 @02:29PM (#25781110)
well, as president he could always give them a pardon, couldn't he? (actually, I have no idea for what he could give pardons. And he won't be presdient long enough to do it for those people. But still...)
Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @03:33PM (#25782089)
The president can pardon all federal offenses excluding impeachment. Whether or not he can self pardon is an untested question; it’s not exactly clear.

Him pardoning the rioters is a nightmare scenario, both politically and for the long term survival of the republic. But the only real solution for this is impeachment and conviction, as generally the pardon power is not subject to judicial review.

Re:Facebook Incubated the Insurrection by dragonwriter on Thursday January 14, 2021 @02:08PM (#25780729)
> I mean, even if they had a signed letter from Trump saying “this is bigly good, do this” that doesn’t stop it from being super-illegal.

It can make it impossible to prosecute, because the President is the Chief Executive and ultimately the authority to which all federal law enforcement answers.

(1) Honest, even if mistaken, belief that action is taken in cooperation with the government defeats the mental state requirement for most crimes.

(2) The doctrine of “entrapment by estoppel” bars criminal conviction where a defendant reasonably relied on misrepresentation of law by an official in undertaking action that is prohibited.

(3) The more common doctrine of entrapment bars criminal conviction where a defendant was induced by a government agent to commit a crime and was not otherwise inclined to commit the crime.

Re:Facebook Incubated the Insurrection by JumpCrisscross on Thursday January 14, 2021 @10:00AM (#25777042)
> a sizable chunk of the mob had no idea that they were doing anything wrong

Has anyone dug into this? What were the actual stories that caused that suspension of critical thinking? (Serious answers, please.)

Re:Facebook Incubated the Insurrection by throwawayosiu1 on Thursday January 14, 2021 @10:11AM (#25777186)
I guess that's because the world is not black and white. You see corrupt cops hurt you while the nice mob helps your family.

It's one of the reasons why successful criminals always have a good community outreach program. Once you have the people on your side, it's very hard for the police to do much.

When gangs selling drugs in Colombia originally started, while they were quite violent, they did take care and look after the local community they were based in. And in return, they local community took care of them by alerting them when the military was closing in as an example.

If you're a young kid growing up in that environment, it's easy to see how you'd consider the military as the bad guys since all you see them do is come in and create chaos / hurt people etc. while the local drug dealer on your street is ensuring that you have food to eat.

Re:Facebook Incubated the Insurrection by thoughtstheseus on Thursday January 14, 2021 @10:21AM (#25777345)
As a group they more often value personal and property rights above government institutions. A more common view in rural areas where you can be quite far from community/govt. services. After seeing months of property rights violations by large groups of people doing the same/similar in D.C. seems reasonable. It’s simple trespassing on govt. property. If someone does something malicious there should be repercussions for them but nearly everyone just trespassed.
Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @10:08AM (#25777146)
Not being sarcastic, but a lot of them are honest-to-god cultists; their connection with concrete reality is tenuous at best. They think that Q is real, and that Trump had secret information about vague evilness being done by Congress (eating babies or similar) that was going to be revealed when they got into the Capitol. Then they were going to arrest them all and execute them as punishment for their alleged crimes. This is what Q believers call “the storm”.

It’s never possible to point to one or two stories that radicalize people like that; it’s not possible to do it that quickly. It takes a certain prior mental state (having a weak social net seems to make it worse), and continual exposure to increasingly radical stories. Like any cult, the rejection of non-members is heavily pushed, which leaves the victim more dependent on the cult and with fewer anchors to reality.

I think any good book about how cults work would be relevant for these people, given that I believe they’re in a cult. But if you’re looking for something more specific, Bellingcat has a great article[0] on the Ashli Babbitt, the Q supporter shot and killed by Capitol police as she breached the final barrier to where congress members were hiding.

0 - Content Warning: lethal violence is discussed and shown in this article. https://www.bellingcat.com/news/2021/01/08/the-journey-of-as...

Re:Facebook Incubated the Insurrection by carapace on Thursday January 14, 2021 @03:37PM (#25782135)
I've heard that too, not that they're a cult so much as a kind of Live-Action Role-Playing that escaped into the real world. I don't know to what extent that's true, but it helps me try to answer one of the questions foremost on my mind, to wit: what the hell did these folks think they were going to do? What was the plan here?

- - - -

From the article you posted there's a line that seems particularly telling to me as an older person who does not use a smart phone:

> As Babbitt lay dying on the floor, her fellow members of the crowd pulled out their phones and began to film

Even in this media-saturated era, that seems particularly cold-blooded or rather disassociated. They didn't help, nor leave, they started taking video.

Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @08:38PM (#25785813)
I don’t think “LARPers escaped into reality” is a good metaphor, because LARPers know they’re playing a game.

The QAnon crowd unquestionably has a lot of members who genuinely believe this stuff. Generally LARPers don’t play act their way into hundreds of federal felonies, nor do LARPers vote along LARP lines.

Also, those guns and bombs are sure real.

Re:Facebook Incubated the Insurrection by carapace on Friday January 15, 2021 @10:12PM (#25799674)
> I don’t think “LARPers escaped into reality” is a good metaphor, because LARPers know they’re playing a game.

That's all I meant by "escaped into reality". These folks (and it seems like most of them were pretty young) seem more like Pokemon GO players who think Pokemon are real than a out right cult.

Re:Facebook Incubated the Insurrection by SV_BubbleTime on Thursday January 14, 2021 @11:53AM (#25778688)
This post like this that remind me the people seriously believe there aren’t just the same number of crazies on the right and left. That “your side“ has all of the “reasonable people” and is “morally right”, what an amazing coincidence.

You only want one side to have to “own“ their crazies. That isn’t how it works. Neither side should be thought of or represented by their “crazies”, that isn’t anywhere near good faith.

Re:Facebook Incubated the Insurrection by rsynnott on Thursday January 14, 2021 @01:42PM (#25780321)
I mean, currently one 'side' is lead by a guy who's still in complete denial that he lost the election, against all available evidence, so this may not be as 'both-sides'-y as you seem to believe.
Re:Facebook Incubated the Insurrection by AnimalMuppet on Thursday January 14, 2021 @01:54PM (#25780515)
That just means that one side has a crazy who is currently in power. It doesn't mean that the other side doesn't have just as much crazy.
Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @02:01PM (#25780633)
Sure. But that’s a pretty weird digression when we’re talking about one specific group of crazies that just attempted an insurrection and got 5 people killed in the Capitol.

When the crazies on the left do something crazy, we can talk about them. But in this context bringing up such a “both sides” argument smacks of whataboutism.

Re:Facebook Incubated the Insurrection by SV_BubbleTime on Thursday January 14, 2021 @03:32PM (#25782079)
> when we’re talking about one specific group of crazies that just attempted an insurrection and got 5 people killed in the Capitol.

Thats only because you are choosing to talk about that exclusively. You aren’t taking into account the violence and destruction about BLM.

I mean, a known BLM voice/advocate went and murdered 5 cops, and not one bit of that blew back at BLM the Org, because no one forced them to own their crazies. None of the destruction, murder and lawlessness over the summer blew back on BLM, Dems, Antifa.

It’s not whataboutism when it’s similar events. A whataboutism would be if someone said “the left doesn’t need to own their crazies because Obama faced criticism for Benghazi”.

Re:Facebook Incubated the Insurrection by carapace on Thursday January 14, 2021 @03:50PM (#25782285)
Well, FWIW, I grew up in SF and I'm mostly Left-leaning (although I would have voted for Mitt Romney rather than Biden if that had been an option) and I'll go ahead and "own" our crazies.

I've met a few Left-wing nut jobs here over the years. I once attended a Communist rally by accident (I had a crush on the math teacher's daughter, no one told me the overnight field trip was to a Commie rally until we were already on the freeway.) Even as a kid I could tell that they were just a pathetic "religion"-without-God, I would say the lot of them (American Communists) are card-carrying loonies.

But (and you can see it coming can't you?)

But they never stormed the capitol.

Two questions for you:

1) What were they trying to do? (If they are not weird cultists?)

2) Can you think of a group on the Left like Qanon on the Right?

I'm sincere, I'm not trying to troll you or talk shit. What do you think?

Re:Facebook Incubated the Insurrection by hdhsh8263 on Thursday January 14, 2021 @01:56PM (#25780543)
The 9/11 truthers were left wingers. The Bernie Bros seem pretty cult-like. Obama certainly had a bit of a cult-of-personality around him at the beginning of his first term.

The difference is that on the right the inmates are currently running the asylum, and a significant portion of the right wing media / messaging apparatus has been pushing this stuff.

Re:Facebook Incubated the Insurrection by ashtonkem on Thursday January 14, 2021 @01:50PM (#25780471)
Please point to the sentence where I made any of those claims.
Re:Facebook Incubated the Insurrection by kenjackson on Thursday January 14, 2021 @10:15AM (#25777254)
They are in a bubble. Watch interviews where some are convinced Trump win because nobody they knew voted for Biden.

If you’re in this bubble and the President tells you to do something, you figure how can it be wrong. The leader of our country is telling me to do this.

Re:Facebook Incubated the Insurrection by __s on Thursday January 14, 2021 @09:48AM (#25776898)
A lot of 4chan was self aware. But on Facebook they think they're saying what everyone is thinking. They aren't trolling
Re:Facebook Incubated the Insurrection by scollet on Thursday January 14, 2021 @06:35PM (#25784628)
Adding a big consideration to this:

Poe's Law is in effect, and with the death of irony can be a (intended or not) recruitment tactic.

Re:Facebook Incubated the Insurrection by hoseja on Thursday January 14, 2021 @09:44AM (#25776848)
It's easy, just give people a soci^H^H^H^H ... community rating to motivate them to behave better!
Re:Facebook Incubated the Insurrection by tester34 on Thursday January 14, 2021 @10:12AM (#25777215)
>^H^H^H^H

hmm?

Re:Facebook Incubated the Insurrection by derwiki on Thursday January 14, 2021 @10:32AM (#25777517)
Backspace control code, repeated four times
Re:Facebook Incubated the Insurrection by drummojg on Thursday January 14, 2021 @11:41AM (#25778482)
I like using ^W for this nerd-rhetoric trope so I don't have to count letters.
Re:Facebook Incubated the Insurrection by __s on Thursday January 14, 2021 @11:05AM (#25778002)
They're referencing "social credit" in China having a parallel concept on social media
Re:Facebook Incubated the Insurrection by Mediterraneo10 on Thursday January 14, 2021 @11:36AM (#25778421)
From newspapers’ biographical sketches of the people who were arrested for the Capitol siege, some of them were on the dole and so they didn't have an employer they could shock, why the others came from parts of the US where their small-business employers may well have sympathized with “Stop the Steal” rhetoric.
Re:Facebook Incubated the Insurrection by spiralx on Friday January 15, 2021 @11:06AM (#25792385)
And some were business owners who flew in on their private jet, some were privately-schooled children of millionaire parents, and others were Olympic medallists.
Re:Facebook Incubated the Insurrection by asveikau on Thursday January 14, 2021 @09:52AM (#25776945)
On the other hand this probably makes the task easier for law enforcement when people make credible threats.

Though that of course has down sides. There used to be periodic news stories about people frivolously calling the cops on facebook posts. (Somehow I don't see a lot of that lately, but I haven't been looking either.)

Re:Facebook Incubated the Insurrection by agumonkey on Thursday January 14, 2021 @12:46PM (#25779479)
We don't know if it's worse or not. Anonymity may help people go wilder than if their name is attached. Or it might be the other way around... it's not clear.
Re:Facebook Incubated the Insurrection by redisman on Thursday January 14, 2021 @01:14PM (#25779899)
Worse than what? Parler seems to also enforce real names only
Re:Facebook Incubated the Insurrection by Bakary on Thursday January 14, 2021 @11:29AM (#25778303)
I actually think this is a good sign. I'd rather live in a world where social norms relax to take into account the loss of privacy and anonymity. The ideal world would be one with those two things still intact, but I guess that ship has long sailed...

The unexpected Trump era served to speed this up, which is probably one of the few silver linings it has. Remember the debates about whether future politicians could be blackmailed on account of what they posted online in their youth? A Boomer of all people just dove right in and bypassed that.

Re:Facebook Incubated the Insurrection by laurent92 on Thursday January 14, 2021 @01:01PM (#25779711)
It is a bit like saying ex-nazis could still have economic leadership after the war, saying “tsallright, everyone did it”. For all we know, social rules didn’t relax around their usage after the war, “collabo” were chased all around the world.

Although you are correct that a lot of people with a shaddy past succeeded to have it forgotten, thanks to a lot of pardons after the war.

Re:Facebook Incubated the Insurrection by Bakary on Thursday January 14, 2021 @01:50PM (#25780463)
I get your point but don't you agree that it's overall better for sexual mores to be freer, eccentric opinions and lifestyles to be less costly (not talking about politics exclusively here), and so on?

The reductio ad nazium isn't a full stop to the discussion

Re:Facebook Incubated the Insurrection by ezzzzz on Thursday January 14, 2021 @09:55AM (#25776979)
Although I am concerned about the 1A and big tech being the arbiters of it, it seems like such a system has yet to go to production (probably never will). I understand that there are technical, financial, and legal complexities that are much more nuanced than 'FB doesn't care, as long as they can profit from potentially dangerous content' and 'FB just wants to suppress any speech which doesn't align with their neo-liberal ideologies'.

What I find troubling is that, a system to find/flag radical/violent content likely exists within the auspices of the NSA. Despite the massive infringement of privacy that these systems create, it seems that they still can't prevent people from being 'radicalized' by content from the platforms that is designed to do exactly that. Furthermore, they couldn't (or didn't) do anything to actually prevent people from storming the Capital. This begs the question, does this massive surveillance state need to exist if it does not do the thing it is purported to do (find and suppress violence, prevent terrorist attacks, etc).

If the owners of the platforms have any conscience, unfortunately, it seems that the responsibility will be up to them. It's murky territory for sure, and you have to strike a balance between far reaching censorship (i.e. infringing of 1A) and allowing disinformation, hate speech, and calls to violence to spread like wild-fire (i.e. how we got into this mess in the first place). I hate to say it, but the older I get, the more something like 'the great firewall' of China seems to make more sense.

Re:Facebook Incubated the Insurrection by agumonkey on Thursday January 14, 2021 @01:11PM (#25779837)
I don't think the NSA was engineered with internet / social networks scale though. But they were already failing in the 9/11 days soo..
Re:Facebook Incubated the Insurrection by ezzzzz on Thursday January 14, 2021 @01:55PM (#25780536)
I mean, PRISM was a post 9/11 thing and yeah, Snowden's leaks directly noted Facebook, YouTube, etc. There is really no telling what exactly is out there, but we know the NSA has massive Data Centers and a massive budget. Basically, even the most personal private information about literally any citizen is just a FISA Warrant away. Things posted in a public forum are a cakewalk.

Maybe they aren't doing anything novel with this data, whatever, this is beside the point. The point is, we can't really count on the State to regulate this stuff, even though, you know, creating and enforcing laws is literally the reason the state exists...

IDK, I hesitantly have to side with big-tech on this, but this is a problem that the State either can't fix, or will not fix.

The internet is a wonderful thing, but it is also very dangerous. Having unfettered access to information, be it true or false, can wield some horrible side effects when such a large swath of the population lacks basic BS detection, critical-thinking and like, base level understanding of civics. Do we need a Vanguard? I wouldn't trust one coming from either side of the aisle in the current climate. Seems like 'censorship' from the platforms is the only viable solution I can see, but that can take a pretty dark turn. At least if it's a private company, you can always leave, create your own thing or find something else...for now.

Re:Facebook Incubated the Insurrection by agumonkey on Thursday January 14, 2021 @03:57PM (#25782385)
Prism is the tool. But I assume that the paradigm is surveilling/fighting small groups not large mobs going slowly insane. But this is just a bedroom idea.
Re:Facebook Incubated the Insurrection by umvi on Thursday January 14, 2021 @09:27AM (#25776623)
Well they didn't develop the platform specifically for spreading radical/violent content. They build a generic platform for spreading thoughts among friends, and racist/violent people used the generic platform to spread their thoughts.
Re:Facebook Incubated the Insurrection by riscy on Thursday January 14, 2021 @09:49AM (#25776906)
The key thing is that they built a reward system into sharing each of those thoughts, which enables an addiction for acceptance from users on the platform. Facebook’s engagement systems / algorithms feed on these addictions. As the article discusses, this causes users to radicalize their posts to garner more attention.
Re:Facebook Incubated the Insurrection by tolbish on Thursday January 14, 2021 @09:29AM (#25776664)
Not quite. They tweaked the way it was run to keep people addicted.
Re:Facebook Incubated the Insurrection by 2pEXgD0fZ5cF on Thursday January 14, 2021 @09:53AM (#25776961)
That is the thing, many argue as if Facebook is a flat, neutral forum, and leave out the whole big algorithmic blackbox it entails. In reality there are no chronological timelines and the regular user is pushed towards the most rage inducing (or as Facebook employees probably euphemize it: "most engaging") content and group recommendations Facebook can apply to an individual.

Facebook was very much an actor in this, not some mere communication infrastructure. Facebook wasn't "warped" by malicious actors, it fanned the flames and by doing so nurtured their hatred and multiplied their reach, all to get the users as addicted as possible to this endless loop. (The same goes for Twitter and Google/Youtube too, of course)

Re:Facebook Incubated the Insurrection by nr2x on Thursday January 14, 2021 @09:43AM (#25776834)
Philip Morris didn’t intentionally develop a system to spread lung cancer, and yet they did.
Re:Facebook Incubated the Insurrection by redisman on Thursday January 14, 2021 @01:22PM (#25780002)
It's not a bad metaphor since PM and FB both did develop their addiction systems on purpose. Cigarettes are not just dried tobacco leaf, there was a ton of R&D to identify and add chemicals that make them extremely addicting. Same with FB, they have optimized for outrage culture etc. - whatever brings the most "engagement".
Re:Facebook Incubated the Insurrection by sct202 on Thursday January 14, 2021 @09:49AM (#25776914)
I've had fb friends report spammed into being temp or permabanned very easily (personal feuds, stalkers), so I would question how they're even measuring quality at this point.
Re:Facebook Incubated the Insurrection by sydd on Thursday January 14, 2021 @10:04AM (#25777097)
Not trying to defend Facebook, but they did not do it on purpose. They developed a really addicting social network where you do as many interactions as possible.

When Facebook started it was a different world: Almost no data privacy laws, internet security in its infancy (e.g. in 2008 HTTPS was a rare new thing, not cross-origin security etc.) and people were spamming Farmville notifications to each other. It just turned out that this structure is an excellent ground for lots of bad things.

Re:Facebook Incubated the Insurrection by nr2x on Thursday January 14, 2021 @11:36AM (#25778412)
That's not true: the EU had lots of national privacy laws under the privacy directive (GDPR was partially intended to unify/simplify that), and the US had sectoral laws such as COPPA and HIPAA, the former of which very much applies to Facebook.
Re:Facebook Incubated the Insurrection by marcod on Thursday January 14, 2021 @01:47PM (#25780420)
Wasn't there also a system developed that was really good at flagging radical content and proceeded to flag all the conservative posts? :p