There's simply no winning this - if you don't apply preventive measures of any kind, your product will deteriorate into a homophobic, racist, sexist ultra-cringe clusterfuck in the blink of an eye [0].
All it takes is a handful of bored teenagers or middle-aged basement-dwellers to turn your product into something the vast majority of your clientele finds appalling.
If you are a company you have the right to choose what you want your product to be and they simply don't want certain headlines pointing at their product.
This has as much to do with "wokeness" as hardcore porn being banned from the Apple app-store, i.e. nothing. It's company policy and you can like it or not, but don't overrate this.
It's nothing new in the slightest and just like publishers can decide to not put books in print that they don't want to be associated with, this company tries to eliminate content they don't want to be associated with - that's all.
[0] https://www.cbsnews.com/news/microsoft-shuts-down-ai-chatbot...
If they use a frozen model then one person using it to generate some NSFW content shouldn't make the output more NSFW-laden for anyone else.
So I don't see how they're "damned if they don't".
The specifics of their approach don't even matter - all it takes is one random Twitter user or media outlet to report on "immoral" output generated by someone to damage the brand image.
That's what they want to avoid and that's why they are trying to take preventive measures.
Why would you think that this company needs to Thought Police their gamers when thousands of others are able to host creativity based games without being dystopian?
When comparing the Minecraft scenario to the AI Dungeon scenario under the purview of "doing creative things with games," I don't find the two scenarios to be much different. However, for one of those things, it's a possibility within the vast play space of Minecraft - you could even create genitalia and display profanity with just alphabet blocks - but for the other scenario, depending on how you see it, it's content that is generated, served, and potentially stored by AI Dungeon. I'd be concerned about the publicity if I was AI Dungeon as well.
Wow. You act as if that's something new :D
There's even an actual job for doing just that: it's called an editor. You know, the people who work in media, publishing houses, TV, radio, papers, magazines, that kind of thing. It's what they do. Everywhere. Editing content. Removing comments, changing words, making sure the views represented in the publication match the intentions and policies of the investors and parent organisations, etc.
You act as if something is new and evil just because it's done with computers. It isn't. It has been the case for as long as papyrus and cave paintings have been around. Back then it was don't anger the chief/king/Pharao, today it's don't anger the Twitter mob or the hand that feeds you. Same difference.
Games are a medium just like magazines or online blogs and comparing blocky dongs in Minecraft with explicit child pornography says a lot about your understanding of "creative expression". Really makes me wonder sometimes.
I get the feeling it's not me who is the radical here.
There is a difference between wanting to remove content that a company don't want to associate itself with and genocide.
For you to even suggest there's a connection says far more about your twisted logic and dysfunctional thought process than mine.
Also AI dungeon is a multiplayer game so yeah - YOUR freedom of expression is limited by OTHER players freedom of not being subjected to certain content. If you don't understand that, work on your social skills.
What? No it isn't.
Technically there's a "multiplayer" mode but that's fundamentally just people taking turns. Restricting certain kinds of content for that reason is nonsense, akin to restricting the kind of story you can write in google docs because multiple people might have been given access to a document.
Your massive overreaction shows no difference to your perceived enemies. This is a game and the creators want to limit the game world and the actions therein to exclude certain content.
This isn't about control over what people think. There are social norms and these change over time.
The "facts" in your message are the same kind of facts that your typical Karen shouts into the phone when they call 911 because there's a negro walking through their neighbourhood. Same level of paranoia, same unhinged out of proportion response.
When was the last time RMS was literally hunted down by a mob? Because if he wasn't, I have to ask who the real fragile flowers are - the ones that get easily offended or the guys like you who see freedom being destroyed and the 4th Reich rising because a private company wants to remove child pornography from their product?
Ridiculous.
https://news.ycombinator.com/newsguidelines.html
(Also, please don't karen: https://news.ycombinator.com/item?id=26880612)
I don't think you understand that banning people over what the Thought Police find "bad" is LITERALLY working to control what people think.
> facts that your typical karen
and you are the typical ignorant fool who complains of "godwin" then resorts to "karen hates black people" drivel. Ignorant of the same calls "Karen" made a hundred times before but all of a sudden skin color matters to everything (hint: there's a word for people who only care about skin color... the funny little hypocrisy of the Woke Crusaders is the racism that permeates every move they make to fight racism by making EVERYTHING about race even when it's not).
> Ridiculous
Considering the other stories about AI dungeon over stepping? I'm more convinced I'm right about the Woke'saders and their march down the same path of others throughout history. It is ridiculous... but that's never stopped the religious in their fervor.
> Child porn
If that's really waht's there? report it to the police and take REAL action... not some half assed Woke'sader steps.
But "think of the childrend" is a close second to "ZOMG THE NAZI'S!" when it comes to justification for overstepping in the Name Of Good. So Sayeth the Wokesaders.
I'd be very worried about this in their shoes and acting very similarly.
"They knew about this problem, they even attempted to half ass fix it, but it's obviously their mind is on the subscriber money, and not preventing blatant CHILD EXPLOITATION!"
Then you throw some more money at a yet unsolvable task, and then in 2 years, when some other outlet gets triggered, you have to defend yourself once again.
"They've know about this problem for 5 years and it's still rampant in their community! Shame on you JERF INC.!"
This is not a technical consideration, it is just PC at its worst.
You either deny that games are a medium or you're under the impression that whatever you read in news publications, books, see in films and TV is the result of the unfiltered creative outlet of the producers. News flash: it isn't.
There's heavy editing going on everywhere and just because it targets a specific computer model in this case instead of a more "traditional" product like a novel, film or stage play doesn't make an iota of difference.
In fact this demonstrates the maturity of the technology and its use if it gets the same treatment as every other public media.
Centralised systems is the only reason why you get these problems.
"Private companies have the right" always fails to account for the fact that these "private companies" are monopolies, with immense control over wide swaths of people's digital lives. No company can compete with them. No alternative to them can be created, because they will immediately be squashed, or fall into obscurity. Participation in these services is "optional," but more and more only in the way that having electricity or running water is "optional."
As a result, these "private companies" effectively become governments, ruling over digital countries you are forced to live in, and affording you little to no rights. And yet, they do this in an ACTUAL country, which DOES afford its citizens rights. Thus a conflict exists.
Ordinary "Private Companies" can censor whatever they like. Monopolies cannot, because doing so threatens free society.
Which forum products do you enjoy and which do you not?
the Internet's original sin!
the irony is that Tech amplifies it but Tech won't (IMHO) be able to fix it with a technological solution (it's not a technical problem).
Note that Google has a "celebrity detection" neural net, along with their child porn recognition net. https://cloud.google.com/vision/docs/celebrity-recognition
A paranoid person might look at this, and the trend of every manufacturer putting NN inference accelerators in their cell phones, and wonder if unauthorized photos of certain persons are being silently flagged for law enforcement review.
The distinction between "thoughts" and "content" here could be made as "whether it is shared with others".
For example, if someone has a private journal they keep using notebook.exe + a local "journal.txt", and in that journal they write a fantasy work (with a header "this is a fantasy") about overthrowing the government, should they be arrested for that?
What about if they write it in google docs, but don't share it with anyone? What about if they write it as a facebook post? What about as a public facebook post without the "this is fantasy" disclaimer?
In the case of AI Dungeon, my understanding is the stories are by default private, and obviously have an understood "this is fantasy" header by their very nature.
If AI Dungeon were creating facebook posts and the limitation they imposed was "you cannot post this to facebook if our algorithm dislikes it", I don't think so many people would call that "thoughtcrime policing".
What they're doing, as I understand it, is closer to someone requiring that notebook.exe can't edit private files that are deemed "bad" in some way, regardless if anyone else will ever see them.
In the case of AI Dungeon that distinction is lifted. By using AI Dungeon what you're effectively doing is engaging in a creative process with the AI. It's no longer a one way channel of your own thoughts. Now AI Dungeon is actually generating content, and that's where things become problematic.
It's also the reason this is not thought crime or thought policing. You are still free to think your own thoughts, and you're even free to write them down. You can write down your thoughts in AI dungeon if you wish. But AI Dungeon is under no obligation to engage with your thoughts if they contain subject matter to which they object. If you want to engage in a fantasy with the AI about abusing minors, you are free to attempt the engagement, and the AI is free to say no. That's not thought policing, that's freedom of association.
If anything, peak faux outrage over "wokeness" is achieved when this is what people get angry about
You do know the idea of thoughtcrime was something enforced by the state and not by a company that's free to control what their product generates, right?
>"corporate self harm for the sake of wokeness"
"Oh no, we lost the business of people who like sexual depictions of minors, what a fucking shame"
Straying away from the prior context a little, the term 'thoughtcrime' along with others such as 'free speech' were coined when it was incomprehensible that a single corporation would have more control over the global population than any government. I don't know whether the time has yet come to re-evaluate which entities these concepts ought to apply to, but it will come.
people can't host their own models either as even their free-tier model needs tens of thousands of dollars worth of compute hardware and memory to run.