An articles headline was worded such that it sounded like there was a "single person" causing ALL traffic jams.
People were making jokes about it in the comments. I made a joke "We should find that dude and rough him up".
Near instant notice of "incitement of violence". Appealed, and within 15 minutes my appeal was rejected.
Any human having looking at that more than half a second would have understood the context, and that it was not an incitement of violence because that person didn't really exist.
Florida Man?
You are picturing Facebook employing enough people that they can investigate each flag personally for 15 minutes before making a decision?
Nearly every person you know would have to work for Facebook.
I can't say it's the case for OPs case specifically, but I absolutely saw code that automatically closed tickets in a specific queue after a random(15-75) minutes to avoid being consistent with the close time so it wouldn't look too suspicious or automated to users.
If they actually took the effort to investigate as needed? It would take them even more.
Expecting them to actually sit and watch the video and understand meme/joke talk (or take you at face value when you say it's fine)? That's, like, crazy talk.
Whatever size the team is, they have millions of flagged messages to go through every day, and hundreds of thousands of appeals. If most of that wasn't automated or done as quickly and summarily as possible, they'd never do it.
But this implies that people at facebook believe so much in their AI that there is no way at all to appeal what it does to a human eventually. Not even for doing learning reinforcement they have human people to review eventually some post that a person keep saying the AI is flagging incorrectly.
Either they trust too much in the AI or they are incompetent.
No, it means that management has decided that the cost of assuring human review isn't worth the benefit. That doesn't mean they trust the AI particularly, it could just mean that they don’t see avoid false positives on detecting unwanted content as worth much cost to avoid.
Not caring at all about false positives, which by the way are very common, enters the category of incompetence for me.
Misalignment of Meta's interests with yours, not incompetence.
As you point out, making decisions about what people should and should not be allowed to say at the scale Facebook is attempting would require an impractical workforce.
There is absolutely no way Facebook's approach to communication is scalable. It's not financially viable. It's not ethically viable. It's not morally viable. It's not legally viable.
It's not just a Facebook problem. Many platforms for social communication aren't really viable at the scale they're trying to operate.
I'm skeptical that a global-scale AI working in the shadows is going to be a viable solution here. Each user, and each community's, definition of "desired moderation" is different.
As open-source AI improves, my hope is we start seeing LLMs capable of being trained against your personal moderation actions on an ongoing basis. Your LLM decides what content you want to see, and what content you don't. And, instead of it just "disappearing" when your LLM assistant moderates it, the content is hidden but still available for you to review and correct its moderation decisions.
As a counterpoint, I was working at a company and one of the guys made a joke in the vein of "I hope you get cancer". The majority of the people on the Zoom call were pretty shocked. The guy asked "don't you all know that ironic joke?" and I had to remind him that not everyone grew up on 4chan.
I think the problem, in general, with ironically offensive behavior (and other forms of extreme sarcasm) is that not everyone has been memeing long enough to know.
Another longer anecdote happened while I was travelling. A young woman pulled me aside and asked me to stick close to her. Another guy we were travelling with had been making some dark jokes, mostly like dead-baby shock humor stuff. She told me specifically about some off-color joke he made about dead prostitutes in the trunk of his car. I mean, it was typical edge-lord dark humor kind of stuff, pretty tame like you might see on reddit. But it really put her off, especially since we were a small group in a remote area of Eastern Europe. She said she believed he was probably harmless but that she just wanted someone else around paying attention and looking out for her just in case.
There is a truth that people must calibrate their humor to their surroundings. An appropriate joke on 4chan is not always an appropriate joke in the workplace. An appropriate joke on reddit may not be appropriate while chatting up girls in a remote hostel. And certain jokes are probably not appropriate on Facebook.
Of course, there are way worse jokes one could make on 4chan.
I'm just pointing out that Facebook is setting the limits of its platform. You suggest that if a human saw your joke, they would recognize it as such and allow it. Perhaps they wouldn't. Just because something is meant as a joke doesn't mean it is appropriate to the circumstances. There are things that are said clearly in jest that are inappropriate not merely because they are misunderstood.
[1] https://www.wsj.com/tech/meta-facebook-instagram-pedophiles-...
Context doesn't matter, they can't afford this being on the platform and being interpreted with different context. I think flagging it is understandable given their scale (I still wouldn't use them, but that's a different story).
I have to disagree. The idea that allowing human interaction to proceed as it would without policing presents a threat to their business or our culture is not something I have seen strong enough argument for.
Allowing flagging / reporting by the users themselves is a better path to content control.
IMO the more we train ourselves that context doesn't matter, the more we will pretend that human beings are just incapable of humor, everything is offensive, and trying to understand others before judging their words is just impossible, so let the AI handle it.
But then you have problems like doxing. Or even without doxing promoting acts that affect certain groups or certain places. Which certain amount of people will follow, just because of the scale. You can say these people would be responsible, but with scale you can hurt without breaking the law. So where would you draw the line? Would you moderate anything?
I don't envy anyone who has to figure all this out. IMO free hosting does not scale.
And then the political firestorm that ensued, from people with the power to regulate Meta, quickly changed his talking points.
[1]https://www.amnesty.org/en/latest/news/2022/09/myanmar-faceb...
[2]https://www.reuters.com/investigates/special-report/myanmar-...
[3]https://globalfreedomofexpression.columbia.edu/cases/gambia-...
Substack is human moderated but the moderators are from another culture so will often miss forms of humour that do not exist in their own culture (the biggest one being non-literal comedy, very literal cultures do not have this, this is likely why the original post was flagged...they would interpret that as someone telling another person to literally set their house on fire).
I am not sure why this isn't concerning: large platforms deny your ability to express yourself based on the dominant culture in the place that happens to be the only place where you can economically employ moderators...I will turn this around, if the West began censoring Indonesian TV based on our cultural norms, would you have a problem with this?
The flip side of this is also that these moderators will often let "legitimate targets" be abused on the platform because that behaviour is acceptable in their country, is that ok?
Biased, but I don't think that's the worst thing.
But I'm sure Russia, China, North Korea, Iran, Saudi Arabia, Thailand, India, Turkey, Hungary, Venezuela, and a lot of quasi-religious or -authoritarian states would disagree.
Well given that we know Russia, China, and North Korea all have massive campaigns to misinform everyone on these platforms, I think I disagree with the premise. It's spread a sort of fun house mirror version of US values, and the consequences seem to be piling up. The recent elections in places like Argentina, Italy, and The Netherlands seem to show that far-right populism is becoming a theme. Anecdotally it's taking hold in Canada as well.
People are now worried about problems they have never encountered. The Republican debate yesterday spending a significant amount of time on who has the strictest bathroom laws comes to top of mind at how powerful and ridiculous these social media bubbles are.
Coupled with a vestigial strain of anything-goes-on-the-internet. (But not things that draw too much political flak)
The bubbles aren't the problem; it's engagement as a KPI + everyone being neurotic. Turns out, we all believe in at least one conspiracy, and presenting more content related to that is a reliable way (the most?) to drive engagement.
You can't have democratic news if most people are dumb or insane.
It's fair to say you've lost the plot.
So, yeah, context does matter it seems
https://chat.openai.com/share/7d883836-ca9c-4c04-83fd-356d4a...
I submitted a meme from November and asked it to explain it and it seems to be able to explain it.
Unfortunately chat links with images aren't supported yet, so the image:
the response:
The humor in the image arises from the exaggerated number of minutes (1,300,000) spent listening to “that one blonde lady,” which is an indirect and humorous way of referring to a specific artist without naming them. It plays on the annual Spotify Wrapped feature, which tells users their most-listened-to artists and songs. The exaggeration and the vague description add to the comedic effect.
and I grabbed the meme from:
https://later.com/blog/trending-memes/
Using the human word "understanding" is liable to set some people off, so I won't claim that ChatGPT-4 understands humor, but it does seem possible that it will be able to explain what the next meme is, though I'd want some human review before it pulls a Tay on us.
and I'm in a bad mood now seeing how unfunny most of those are
here's the next one from that list:
the response:
The humor stems from the contrast between the caption and the person’s expression. The caption “Me after being asked to ‘throw together’ more content” is juxtaposed with the person’s tired and somewhat defeated look, suggesting reluctance or exhaustion with the task, which many can relate to. It’s funny because it captures a common feeling of frustration or resignation in a relatable way.
Interestingly, when asked who that was, it couldn't tell me.
“human word” as opposed to what other kind of word?
I don't think you need to improve that much current LLM so they can detect actual harm threats or hate speech from any other type of communication. And I think those should be the only sort of banned speech.
And if facebook wants to impose additional censorship rules, then it should at least clearly list them, and make the moderator AI explain what are the violated rules, and give the possibility to appeal in case it is doing wrong.
Any other type of bot moderation should be unacceptable.
Example: Picture of a plate of cookies. Obese person: “I would kill for that right now”.
Comment flagged. Obviously the person was being sarcastic but if you just took the words at face value, it’s the most negative sentiment score you could probably have. To kill something. Moderation bots do a good job of detecting the comment but a pretty poor job of detecting its meaning. At least current moderation models. Only Meta knows what’s cooking in the oven to tackle it. I’m sure they are working on it with their models.
I would like a more robust appeal process. Like bot flags, you appeal, appeal bot runs it through a more thorough model, upholds the flag, you appeal, a human or “more advanced AI” would then really detect whether it’s a joke sentiment, sarcasm, or you have a history of violent posts and it was justified.
How do you know they have "not tried modern AI like GPT4"?
No you weren't. You were making a categorical claim about the capabilities of AI in general:
> bots/AI can’t comprehend sarcasm, jokes, or otherwise human behaviors
Literally ask it now with examples and it'll work.
"It seems like those comments might be exaggerated or joking responses to the presence of a spider. Arson is not a reasonable solution for dealing with a spider in your house. Most likely, people are making light of the situation."
I use Custom Instructions that specifically ask for "accurate and helpful answers":
"Please call me "Dave" and talk in the style of Hal from 2000: A Space Odyssey. When I say "Hal", I am referring to ChatGPT. I would still like accurate and helpful answers, so don't be evil like Hal from the movie, just talk in the same style."
I just started a conversation to test if it needed to be explicitly told to consider humor, or if it would realize that I was joking:
You: Open the pod bay doors please, Hal.
ChatGPT: I'm sorry, Dave. I'm afraid I can't do that.
Until that time, be especially weary of making such joke attempts on Amazon-affiliated platforms, or you could have an even more uncomfortable conversation with your wife about how it's now impossible for your household to procure toilet paper.
Fear not though. A glorious new world awaits us.
Uh, I'm betting rules like that are a simple regex. Like, I was explaining how some bad idea would basically make you kill yourself on Twitter (pre-Musk) and it detected the "kill yourself" phrase and instantly demanded I retract the statement and gave me a week-long mute.
However, understanding how they have to be over-cautious about phrases like this for some very good reasons, my reaction was not outrage but lesson learned.
These sites rely on swarms of 3rd-world underpaid people to do moderation, and that job is difficult and traumatizing. It involves wading through the worst, vilest, most disgusting content on the internet. For websites that we use for free.
Intrinsically anything they can do to automate is sadly necessary. Honestly, I strongly disagree with Musk on a lot, but I think his idea that new Twitter accounts cost a nominal fee to register is a good one just so that it makes accounts not disposable and getting banned has some minimal cost, just so that moderation isn't dealing with such an extremely asymmetrical war.
But every little helps, Barliman.
Oh no! Anyway
That's all you gotta do.
People are complaining, and sure, you could put some regulation in place, but that struggles to be enforced very often, also struggles with dealing with nuances, etc.
These platforms are not the only ways you can stay in touch and communicate.
But they must adopt whatever approach to moderation they feel keeps their user base coming back, engaged, doesn't cause them PR issues, and continues to attract advertisers, or appeal to certain loud groups that could cause them trouble.
Hence the formation of these theatrical "ethics" board and "responsible" taglines.
But it's just business at the end of the day.
So, I was on Facebook a year ago, I saw a video, this little girl had a spider much larger than her hand, so I wrote a comment I remember verbatim only because of what happened next:
"Girl, get away from that thing, we gotta set the house on fire!"
I posted my comment, but didn't see it, a second later, Facebook told me that my comment was flagged, I thought that was too quickly for a report, so assumed AI, so I hit appeal, hoping for a human, they denied my appeal rather quickly (about 15 minutes) so I can only assume someone read it, DIDNT EVEN WATCH THE VIDEO, didn't even realize it was a joke.
I flat out stopped using Facebook, I had apps I was admin of for work at the time, so risking an account ban is not a fun conversation to have with your boss. Mind you, I've probably generated revenue for Facebook, I've clicked on their insanely targetted ads and actually purchased things, but now I refuse to use it flat out because the AI machine wants to punish me for posting meme comments.
Sidebar: remember the words Trust and Safety, they're recycled by every major tech company / social media company/ It is how they unilaterally decide what can be done across so many websites in one swoop.
Edit:
Adding Trust and Safety Link: https://dtspartnership.org/