How do you create a general content site, without spending money on human review and curation of all uploads, while segregating erotic and non-erotic content, without having your entire site banned/blocked/gated around the world for hosting erotic content?
This has affected Amazon, Blogspot, Facebook, Google, Imgur, Patreon, Reddit, Tumblr, Twitch, Youtube. Every general content site has this problem. Most try to solve it with "user flags", which are promptly weaponized and abused to silence others. Problems constantly recur around statues, breastfeeding, swimsuits. Advertisers want content to be segmented with certainty, but site operators don't want to pay human beings to do that. Standards of "erotic" vary wildly per city, country, religion. The list goes on.
What if human curation is the only valid solution? We haven't found any other solution that works yet, and AI is barely able to recognize human beings, much less discern whether content is intended to be categorized as erotic, non-erotic, or both.
I wonder if a patron-driven community that sets its own moderation policy wouldn't have this problem, because when a topic gets too large it will inevitably splinter into smaller communities where the preferred moderation style of each subset can be catered to.
AI moderators are terrible at enforcing a complex set of practices and rules.
Human moderators are excellent at enforcing a complex set of practices and rules.
Both are subject to the whims of those defining the practices and rules, and their enforcement will always fall within scope of those definitions. If Twitch’s moderators are given full empowerment to set the rules they moderate by, then it is appropriate to blame them for what is perceived as faulty moderation decisions. Chances are, they do not have any such authority, and at best can “recommend” or “advise” while being compelled to silence by their overlords.
You are absolutely right that humans make biased decisions, no matter how much we work to correct for it; judge sentencing becomes more strict when they’re hungry or their local sports team lost, and referees are less likely to penalize the home team when in the home stadium with home fans yelling at them. But these biases can be documented, studied, and gradually accounted for in training and post-decision reviews. It’s not perfect, but it’s still great.
With AI moderation, we bake the biases into the dataset and training models, and then we throw complex rule making decisions at a nascent ML network that can’t discern the simplest of decisions that any human moderators could: “Is this erotic or non-erotic content?”. Setting aside the biases of any possible training set versus Rule 34, it is dead simple to outwit any AI in this regard, in ways that most human moderators would detect instantly. It’s not perfect, and in fact it’s pretty awful.
I agree that the rulemaking decisions of modern sites are often terrible, biased, and exclusionary of entire categories of human beings and behaviors. However, the errors made by human moderators trying to service the complexity assigned to them do not somehow excuse the staggering naivety and incompetence of AI moderators. The heavyweights in this Ml moderation industry — Google, Amazon, Facebook — have failed to deliver effective ML moderation after billions of dollars and cumulative decades of investment, and paper over their failure by using user flags and human review teams to disguise the sharp edges of their solutions.
The "pools, hot tubs, beaches" exception was a (stupid) loophole and they should just close it (I suspect that this is the end result moving forward, eventually). The hard part for Twitch is figuring how to do this with out appearing sexist.
This situation has been ongoing for awhile with individuals pushing the boundary of sexual content, but this response from Twitch only occurred after a partner who creates this type of content pissed off Twitch's advertisers.
Like facebook or twitter they just need to have CONSISTENT AND CONSISTENTLY APPLIED rules. I can make a judgement on your platform when those two things are happening.
This is not happening here. Twitch is not a pure Gaming-site anymore, for several years now. And those hot tub-streams are not listed in gaming-categories, they are in non-gaming-categories like "Just Chatting", "Music", even "Travel & Outdoors" (because there are also legit beach-streams which play the hot tub-routine).
Twitch started as Gaming-Only, and the majority of content is still gaming. But people should realize that Non-Gaming is already big on twitch too, and it grows. Twitch is bringing sports and fashing-events to the platform. Music has grown string the last year because of COVID. And some people have found their niche in tame porn-content. Which technically is kind of a joke, because the biggest Hot Tub-Streamer has sexualized content on Twitch for years. But in the past she used the Just Dance-Game to create sexualixed content, or did some fitness-stuff. She is literally infamouse on the platform for this, and Hot tub is just the latest trend in a series of long running content-attempts. Just because it now is now missing the gaming-part, should make it worse? I don't think so.
I'm not at all in touch with twitch stuff, so I'm just reading about this now. That's horrible. Would making stricter bans help?
In what way does this foster non-productive attitudes in boys and young men?
To be clear, there's nothing wrong with doing suggestive cosplay or things like that. I also doubt that the average person is going to watch Amouranth, and then immediately assume that all the women interested in gaming are curating the same kind of appeal - this kind of influence is more subtle than that. But I do believe that the juxtaposition of male streamers' content, and many of the most popular women's content likely fosters these stereotypes.
Also, Amouranth does actual pornography for a living, her own interest is absolutely more aligned towards getting new OnlyFans subs than some platonic ideal of enjoying gaming for its own sake.
The whole point seems to be about separating 'child safe' content. This cannot be done automatically, they would have to hire moderators to manually curate channels and then block access by age.
On the other hand, I do think the juxtaposition of this content with the rest of Twitch content is problematic. I think putting this content in the same category as gaming content unintentionally conveys the message, "Men garner popularity by exhibiting their skills, women garner popularity by exhibiting their bodies." I suspect this juxtaposition of the most popular male streamers' content with that of some of the most popular women's content on the platform and exposing this young people ends up fostering non-productive attitudes among boys and young men. Other women on the platform have complained about their audiences pressuring them into producing similar content. I've also heard from women and girls that it's off-putting to see the prevalence of women in bikinis, not playing any games, on a platform that ostensibly about gaming. I think Twitch is in the right to see this as a problem.
But what's the solution here? On the one hand, I think it's giving these streamers the short end of the stick to have ambiguous policies and issue unexpected demonetizations or bans. Maybe a more effective approach would be to have stronger separation between "just chatting" content and gaming content, to retain this content but mitigate the problem of that juxtaposition. I suspect this is what the "Pools, Hot Tubs, and Beaches" category will probably be, but maybe it'd be better to spin this off into sister platform that isn't explicitly tied into gaming.