News for hackers. Stuff that matters.
Re:Social-media platforms are destroying evidence of war crimes by schoen on Saturday September 26, 2020 @09:42PM (#24603534)
I was trying to reply to a post that got flagged, so I'll repost at the top level instead:

I strongly disagree with [the other poster's lack of concern about war crimes], but I want to try to paraphrase the part of your intuition that makes sense to me.

Facebook gets criticized by its users and governments both for taking down "too much" and "too little", sometimes with regard to the same post or subject area.

Suppose user X posts something related to an armed conflict, violence, suffering, or death. This post might be part of a crime by X against Y, or evidence of a crime by Y against Z, or evidence of a crime by Y against Z, or not really a crime at all but just really disturbing and upsetting. Also, in various circumstances people might want records about violent crimes against them to be destroyed, or publicized, or not destroyed but not publicized (only used by some judicial process, or truth-and-reconciliation process, or historians, or something). Also, user X might have an intention that's different from the primary value or valence of the content, like prurient enthusiasm for violence, or making one of the parties depicted look bad, or trying to intimidate one of the parties depicted.

In order to figure out which category (or categories) a post falls into, Facebook has to (1) learn the language(s) involved in all posts, (2) learn the political context of violent conflicts, (3) perform some level of adjudication and fact-finding about political conflicts and disputes, and maybe even (4) try to understand the motives of the person who posted something on each particular occasion.

Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

Re:Social-media platforms are destroying evidence of war crimes by save_ferris on Saturday September 26, 2020 @09:56PM (#24603586)
> Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

I’ll grant that we’re in uncharted territory as far as the scale and depth of what a company like Facebook has to deal with on a regular basis regarding the amount and variance in the content that they see and manage. That said, Facebook constantly tells us how they want to change the world for the better.

If that’s not just marketing bullshit and they want us to take them at their word, then they need to recognize that the position they’ve put themselves in demands a level of accountability and responsibility that they’re clearly not comfortable with. Ultimately, citizens should be able to define what’s reasonable to expect out of Facebook, not the difficulty of a particular content problem. Becoming one of the largest tech companies in existence doesn’t grant one immunity from real problems involving their content.

If Facebook can’t manage their content at scale to address these kinds of issues, then perhaps they shouldn’t be managing content at this kind of scale.

Re:Social-media platforms are destroying evidence of war crimes by bostik on Sunday September 27, 2020 @04:54AM (#24605216)
The problem is much bigger than that. Can you tell the difference between terrorists and war criminals committing an atrocity, and a militia of freedom fighters delivering their brutal but understandable form of justice?

Can anyone?

Re:Social-media platforms are destroying evidence of war crimes by dmurray on Sunday September 27, 2020 @07:41AM (#24605892)
Easy - ask the US government which ones are the bad guys. If you get too far away from where they draw the line between terrorists and freedom fighters, your platform won't be welcome anywhere in the western world anyway.
Re:Social-media platforms are destroying evidence of war crimes by bergstromm466 on Sunday September 27, 2020 @12:06PM (#24607667)
I think you're joking... but sarcam is hard to spot in text format

https://en.wikipedia.org/wiki/United_States_involvement_in_r...

Re:Social-media platforms are destroying evidence of war crimes by dmurray on Monday September 28, 2020 @10:18AM (#24616833)
Under my proposal, all justified military actions aligned with those in your link would be considered good and necessary, and censored only if necessary for military secrecy or to avoid alarming people. All atrocities committed by those aligned to other sides should be considered acts of terrorism, and of course it should be illegal to cover up evidence of such war crimes. Easy!
Re:Social-media platforms are destroying evidence of war crimes by bostik on Monday September 28, 2020 @11:29AM (#24617684)
Terry Pratchett would be proud. He even formalised the universal battle cry: "remember the atrocities done to us to justify the atrocity we are about to commit!"

As would another, earlier British author. Can you remember when you were not at war with Oceania?

Re:Social-media platforms are destroying evidence of war crimes by jbullock35 on Sunday September 27, 2020 @07:17AM (#24605801)
Yes. Sometimes it's not hard:

> In 2018 the BBC looked into a video circulating on social media showing soldiers blindfolding and then shooting two women and children in Cameroon.

Re:Social-media platforms are destroying evidence of war crimes by bostik on Sunday September 27, 2020 @12:12PM (#24607725)
Sure, sometimes you do get an obviously easy pick.

But what I'm talking about are the amateur snuff clips where a small group of men armed to their teeth and dressed in camo stand in front of tied, bound and kneeling young men, the latter of which are then executed, one by one. And it's only later you learn that the young men were serial war criminals and rapists who not only committed the acts themselves but forced their victims to commit them on their own families, before feeding them a hand-grenade brunch.

For us it's disgusting and horrifying. For the societies where it happened that's evidence of justice having been carried out.

And the worst of it? If material like that was filmed on a Hollywood studio lot, you'd give it PG, or "15" at best. After all, what's not to like in a some good old-fashioned vigilantism?

Re:Social-media platforms are destroying evidence of war crimes by Xelbair on Sunday September 27, 2020 @07:19AM (#24605812)
No one can. It all depends which side you support - the only option is to present both viewpoints in equal measure to 3rd party audience.
Re:Social-media platforms are destroying evidence of war crimes by SpicyLemonZest on Saturday September 26, 2020 @10:29PM (#24603735)
The problem is that different sets of people have different beliefs about what constitutes accountability and responsibility. For example, the article criticizes algorithmic moderation of terrorist content as an abdication of responsibility, but many groups argue that manual moderation is an abdication of responsibility - the EU is considering a law that would require Facebook to algorithmically moderate terrorist content.

That doesn't mean, of course, that nobody can have an opinion on what the right thing for Facebook to do is. But you can't abstract over the substance of the criticism and say Facebook isn't "addressing these kinds of issues" without specifying whose standards they ought to follow.

Re:Social-media platforms are destroying evidence of war crimes by closeparen on Saturday September 26, 2020 @11:06PM (#24603903)
I don't understand this idea that "citizens" can hold the reins of censorship. If an item's removal is up for public debate, it was never really removed. E.g. it does not really solve the problem of Holocaust denial content if you still have people complaining that Holocaust denial content should be allowed. And it is not a democratic law anymore if you don't get to criticize it.

Censors operated in secret and beyond accountability not because of some accident of history, but because it was essential to the nature of their work.

Re:Social-media platforms are destroying evidence of war crimes by Qwertious on Sunday September 27, 2020 @07:46AM (#24605924)
Censorship isn't all-or-nothing though - spoiler tags being a common example. It stops you from reading it and says "warning you don't want to read this because X", then leaves it up to you. You could censor misinformation/etc with this method, yet still be held accountable.
Re:Social-media platforms are destroying evidence of war crimes by closeparen on Sunday September 27, 2020 @06:48PM (#24610813)
Disclaimers can be helpful but you’re still giving those views a platform, and horrible people who want to congregate and reinforce their views to each other can still do it. I don’t think this satisfies the anti-big-tech crowd, although I’d be happy if it did.
Re:Social-media platforms are destroying evidence of war crimes by 188201 on Saturday September 26, 2020 @11:53PM (#24604110)
Maybe put it in another way. If Facebook is only a platform of communication, just like telephone or email, no one is going to have a ground to complain about Facebook inability to ban or ignore crime or hate speech or whatever unpleasant thing people like to ban it.

However, Facebook choose to use algorithmic feed to provide new information to user, then it become a media company in this sense. So as a traditional media company of course Facebook has the responsibility to ensure the content is suitable for public even if Facebook is not the producer of the content. Just give user chronological feed if they don't want to invest the effort. Facebook can't maintain its business model while tried to dodge responsibility.

After all, the problem is most people accept this kind of business model and most people don't care. When social media come to power they have enough capital for lobbying to persuade the government not to outlaw their business model.

Re:Social-media platforms are destroying evidence of war crimes by burkaman on Saturday September 26, 2020 @10:39PM (#24603776)
> Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

That is their responsibility. If they have an unreasonable amount of responsibility, then it follows that they have an unreasonable amount of power. The solution is to take away that power, not to live with it being wielded uncontrollably.

Re:Social-media platforms are destroying evidence of war crimes by jdietrich on Sunday September 27, 2020 @01:47AM (#24604495)
Facebook want to be regulated, partly because they're better equipped to deal with regulation than upstart competitors and partly because it means that these dilemmas become the responsibility of government.

https://www.washingtonpost.com/opinions/mark-zuckerberg-the-...

Re:Social-media platforms are destroying evidence of war crimes by burkaman on Sunday September 27, 2020 @04:59PM (#24610093)
Absolutely nobody is holding Zuckerberg accountable for anything he says in an article like this, so it's effectively meaningless, but we can still analyze it a little for fun.

Note that he does not call for any regulations that would actually be new to Facebook. He only gives examples of things that Facebook already does, such as releasing transparency reports and adhering to GDPR. So I would read this article as "Facebook does not need to change in any way, but everyone else should be like us".

Does Facebook back up any of this article with actions? Do they support politicians who would enact these policies, or do they evenly support all points of view so they have influence with everyone? Does Zuckerberg hold private dinners with privacy advocates and supportive politicians to discuss policy and strategy? Is Facebook a prominent sponsor of any organizations that are working to make these ideas reality?

Re:Social-media platforms are destroying evidence of war crimes by SpicyLemonZest on Saturday September 26, 2020 @10:42PM (#24603788)
It's not uncontrollable. It's just controllable by a heterogeneous set of people with different goals, ideals, and policy prescriptions. Splitting up Facebook's power among a dozen smaller networks wouldn't change that fundamental conflict.
Re:Social-media platforms are destroying evidence of war crimes by burkaman on Saturday September 26, 2020 @10:54PM (#24603848)
Facebook has a corporate hierarchy, and there are a small number of people at the top who have real meaningful power, even if they can't micromanage every decision. Splitting up their power wouldn't magically fix any problems, but it would lessen the potential damage one person or small group of people could do.

It would also limit the damage an outside actor could do by abusing a platform, the same way America's "distributed" presidential election is safer than having one centralized election or one system that every state uses.

Re:Social-media platforms are destroying evidence of war crimes by unishark on Sunday September 27, 2020 @12:08AM (#24604157)
I don't see how scale matters to the moral question. Whether they are a giant multinational company, or a little personal blog, the problem is still there. They currently do not have employees who examine this stuff or decide if it needs to be reported to the authorities. You think the law should require it? If so why then shouldn't I also be required to read what's in my email spam folder to check for crimes too? Sure it's not very likely there's much there, but we aren't talking about a new law just applied to me. It would apply to all other individuals like me too, and 300 million people being required to check our spam folders and personal blogs may well uncover far more crimes than on facebook.
Re:Social-media platforms are destroying evidence of war crimes by SpicyLemonZest on Saturday September 26, 2020 @11:03PM (#24603889)
Sure, there are lots of reasons it might be better to decentralize. I'm just saying that achieving specific content moderation standards isn't one of them, because there's no reason to expect new, smaller companies to favor Human Rights Watch's preferred policies.
Re:Social-media platforms are destroying evidence of war crimes by burkaman on Saturday September 26, 2020 @11:16PM (#24603939)
Yeah ok, we agree. I don't think smaller companies would moderate better, just that it would be less of a concern when they do it badly. I mean there are small social medias companies right now that don't moderate at all, but it's not a pressing issue because they don't have much impact.
Re:Social-media platforms are destroying evidence of war crimes by dalbasal on Sunday September 27, 2020 @12:23PM (#24607801)
>Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral

I think there are two ways to think about Facebook, in the context of this article. One is as a journalistic organisation. If we go that way, then yes, I think it is reasonable to expect Facebook to make massive efforts to understand context and make informed decisions.

These decisions are impactful. If you are the primary journalistic news source for something this meaningful, then yes, you have a responsibility to do this job well.

The other way of seeing Facebook is as a neutral platform. In that case, they need to have genuinely neutral and transparent rules. Ad hoc, subjective, closed door decision making is not neutral.

The problem is that Facebook is having it both ways. So, they're getting criticism (as you point out) from both directions. That's not unfair to Facebook, it's a choice they make.

Re:Social-media platforms are destroying evidence of war crimes by DSingularity on Saturday September 26, 2020 @10:19PM (#24603689)
Facebook creates these features and refuses to own their consequences. They gave everyone a megaphone and a private tv channel. Now they want to run away from owning responsibility for the content which they use to bring the users who will see the ads which line their pockets. Unacceptable.

Maybe it’s time to cancel features if you don’t want to dedicate some portion of your many billions of profits to solve the problems which said features create for society.

Oh and to everyone who will say it’s hard, maybe you can’t solve these problems then you shouldn’t be rolling out a feature. It’s just that simple.

Re:Social-media platforms are destroying evidence of war crimes by gfxgirl on Sunday September 27, 2020 @12:17AM (#24604190)
So the phone company provided a way for criminals to organize in secret and communicate with each other without having to meetup in person so the phone company is responsible for that crime?

Unless I mis-understood your argument. It seemed to be that you should be responsible for everything bad someone else does with something you made. You made a cooking knife. Someone stabs someone with it. It's your responsibility. You shouldn't have introduced cooking knives into the world knowing that people might stab others with them.

Re:Social-media platforms are destroying evidence of war crimes by uniqueid on Sunday September 27, 2020 @02:25AM (#24604637)
My take on the debate over internet censorship is that the "free speech" contingent badly wants to deal with it using elegant, consistent, universal principles.

While a solution that meets those criteria should always be the goal, we must recognize when it isn't possible. If we don't, we wind up with something that satisfies our ideology without actually being a good solution.

Such issues often result in new law. If any phenomenon creates a certain level of harm, a society is liable to alter its laws to deal with it, breaking with convention if necessary.

Regarding your phone company example, what that means is that the answer to your question might depend on the extent to which the criminal activity is harming society.

Regarding Facebook, I'm open to betraying my normal principles, because the amount of injury Facebook does to the world justifies exceptional remedies.

Re:Social-media platforms are destroying evidence of war crimes by Xelbair on Sunday September 27, 2020 @07:23AM (#24605830)
Not really, it would be akin to phone company allowing it's users to create multi-user international terrorist hotline, and refusing any kind of responsibility for it... while also sending out promotional material to people they deemed 'potential terrorists'
Re:Social-media platforms are destroying evidence of war crimes by scotu on Monday September 28, 2020 @11:45AM (#24617885)
I think you are not taking into account that the knife and the phone are not "mass/broadcast" tools. They are one to one, one to few at most.

Moreover facebook is not a neutral conduit, the algorithmic feed act as an editor for a newspaper (and an editor that can give each person their own personal newspaper at that!)

Re:Social-media platforms are destroying evidence of war crimes by bjelkeman-again on Sunday September 27, 2020 @06:27AM (#24605627)
That is a simplified argument. Facebook is not a phone company. A phone company has an amplification effect on communication, but Facebook, with a billion customers reachable through their choice of algorithms is in a totally different class. A phone company doesn’t push content on the user. Facebook does.
Re:Social-media platforms are destroying evidence of war crimes by heavyset_go on Sunday September 27, 2020 @02:36AM (#24604675)
> You made a cooking knife. Someone stabs someone with it. It's your responsibility. You shouldn't have introduced cooking knives into the world knowing that people might stab others with them.

This is the logic used to put drug dealers and manufacturers in prison when people overdose on their drugs and die.

Re:Social-media platforms are destroying evidence of war crimes by deelowe on Sunday September 27, 2020 @02:55AM (#24604774)
> So the phone company provided a way for criminals to organize in secret and communicate with each other without having to meetup in person so the phone company is responsible for that crime?

This is a bad analogy. The phone company isn't a broadcaster. Facebook is.

Re:Social-media platforms are destroying evidence of war crimes by indymike on Sunday September 27, 2020 @02:56AM (#24604780)
I don't see that. The reason that Facebook was even possible is safe harbor laws that shield them and every one of their vendors from liability.
Re:Social-media platforms are destroying evidence of war crimes by Xelbair on Sunday September 27, 2020 @07:18AM (#24605806)
>Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

I would say it depends on how Facebook presents itself to the wide world.

Is is just a content aggregator that allows others to share their thoughts? Nope, we shouldn't expect them to do it.

Are they a platform, where they curate the content? absolutely yes, they chose this - you can't eat the cake and still have it.

Re:Social-media platforms are destroying evidence of war crimes by atoav on Sunday September 27, 2020 @05:57AM (#24605515)
While whoever is blocking content indeed finds themselves between a rock and a hard place and will never be able to please everybody, I don't think there is only a choice between "leave it up" and "block it".

I think one solution would be to archive certain violent imagery in a nonpublic storage and give access to historians, journalists and scientists on a project basis to these. This isn't without challenges and cost, but as a humanity we have to do certain things to make sure violations of our human rights don't get flagged for deletion. I just wish our great minds would actually care about problems like these beyond chasing the next market based disruptive technology with totally unclear societal consequences.

Re:Social-media platforms are destroying evidence of war crimes by tripzilch on Wednesday September 30, 2020 @06:01AM (#24637087)
> Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

It's reasonable to hold them accountable for the extent they're facilitating the problems. Even (especially) if it's an unavoidable by-product of FB's existence.

Re:Social-media platforms are destroying evidence of war crimes by PeterisP on Sunday September 27, 2020 @06:39AM (#24605672)
There's no inherent conflict between taking things down and preserving evidence - it should not be difficult for Facebook to "cease publishing" a particular piece of content (i.e. stop showing it to the public) while preserving it in their systems as evidence, together with all the metadata of who/when/how posted or reposted it.

In fact, for the main categories that must be taken down quickly (e.g. child abuse material, death threats, etc) it seems obvious that the evidence must be preserved - why not extend it to all the violent stuff that gets banned.

Re:Social-media platforms are destroying evidence of war crimes by beefield on Sunday September 27, 2020 @07:01AM (#24605751)
> Is it reasonable to expect Facebook to do all those things

Yes. It is then up to Facebook to decide if they want to play the game where they are expected and required to do that, or dissolve themselves to an insignificant enough operation where it is no more reasonable to expect that. Either you are the most significant social media company in the world and face the consequences, or you are not. This is free world to decide those kind of things...

Re:Social-media platforms are destroying evidence of war crimes by roenxi on Sunday September 27, 2020 @03:53AM (#24605008)
It may not be the first instinct in a forum of programmers; but really there is a question hanging over whether something like Facebook can/should/will continue to be an international company.

At some point it could be discovered that the problem they are trying to solve is politically unsolvable. Regulatory structure starts to build up and it becomes impossible to run multinational social companies; as a topic for thought experiment.

Re:Social-media platforms are destroying evidence of war crimes by zby on Sunday September 27, 2020 @06:17AM (#24605585)
Or we get a world government.
Re:Social-media platforms are destroying evidence of war crimes by unityByFreedom on Sunday September 27, 2020 @12:33AM (#24604242)
> Is it reasonable to expect Facebook to do all those things, compared to other choices that are consistent, neutral, and inevitably result in various type I and type II errors with respect to the nature and purposes of posts related to violence?

No, and that is precisely why their moderation should be transparent.