News for hackers. Stuff that matters.

A comment on Announcing GPT-NeoX-20B. Parent comment

Re:Announcing GPT-NeoX-20B by qlm on Wednesday February 02, 2022 @12:53PM (#30181192)
What was AI Dungeon's downfall? Can't find much about it.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by minimaxir on Wednesday February 02, 2022 @01:02PM (#30181334)
tl;dr AI Dungeon was required to add additional content filters after it went too off the rails, which caused community backlash.

https://www.wired.com/story/ai-fueled-dungeon-game-got-much-...

[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by fpgaminer on Wednesday February 02, 2022 @01:17PM (#30181559)
It was more than that. They also significantly downgraded the model. I didn't follow the details, but IIUC Dragon used the 175B directly initially, then I think they went down a model size at Open AI's behest. Finally, when Open AI announced pricing, AI Dungeon had to downgrade the model further.

But yes, the content filtering got out of hand too. I was initially fine with it, as its proposed intention was to filter out really illegal stuff, like underage content. I rarely hit the filter. But then they tweaked it at some point and I was triggering it constantly on otherwise benign stuff.

And they broke features constantly.

When I unsubbed the state of AID was broken features, micro-transactions, terrible AI model, and a glitchy, puritanical content filter.

The plus side is that it made the puny GPT-Neo model look like a godsend.

[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by causi on Wednesday February 02, 2022 @01:45PM (#30181991)
really illegal stuff, like underage content

Wait, isn't this output just text? How is a text AI generating illegal content?

[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by NovemberWhiskey on Wednesday February 02, 2022 @02:08PM (#30182370)
The content may not be illegal to possess, but if it's obscene, then it can be illegal to sell it, produce it with the intention of selling it, transport it, distribute it, and so on.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by capableweb on Wednesday February 02, 2022 @03:08PM (#30183257)
Could it really? I was under the impression that unless you incite someone to commit crimes (or confess to crimes), the story would be covered under "art" and therefore protected. It's just text after all. Where does the limit for "obscene" go?
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by causi on Wednesday February 02, 2022 @03:13PM (#30183332)
It's very funny to imagine picking up a romance novel and making it illegal by scrawling "by the way the girl was actually 16 the whole time" on the inside of the back cover.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by NovemberWhiskey on Wednesday February 02, 2022 @03:25PM (#30183518)
In the U.S., it's called the Miller test: https://en.wikipedia.org/wiki/Miller_test
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by capableweb on Wednesday February 02, 2022 @03:35PM (#30183645)
Wow, I had no idea, that sounds really bad. The whole book banning debacle now makes sense and seems legal. That test seems to me to give way for courts to basically judge however they want, as all those three criteria are very subjective.

Also first time I hear about "patently offensive" and now I'm laughing. Thanks!

[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by namlem on Wednesday February 02, 2022 @08:59PM (#30187439)
It wouldn't be illegal in the US, but it would be in many other countries.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by miohtama on Wednesday February 02, 2022 @05:13PM (#30184836)
It’s called thoughtcrime

https://www.quora.com/Do-thought-crimes-exist-in-U-S-law

[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by namlem on Wednesday February 02, 2022 @09:05PM (#30187495)
Miller v California has been undermined so severely by subsequent decisions that it basically doesn't apply anymore.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by judge2020 on Wednesday February 02, 2022 @10:42PM (#30188307)
Quora is quite unhelpful in any context.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by bitforger on Wednesday February 02, 2022 @01:34PM (#30181812)
I believe they're currently using AI21's 178B Jumbo model for Dragon. Since they're completely off of OpenAI now, the content filter is much more lax.
[ Parent | on HN ]
Re:Announcing GPT-NeoX-20B by TulliusCicero on Wednesday February 02, 2022 @11:56PM (#30188873)
It should be noted that the content filters were implemented really badly. Like, saying “my ten year old truck” would suddenly stop your story in its tracks, lots of things would trigger it. Plus, people became uncomfortable with the idea that the AI Dungeon employees were potentially reading your stories at any time.
[ Parent | on HN ]