News for hackers. Stuff that matters.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by flangola7 on Thursday March 02, 2023 @01:36AM (#34992745)
AI is a new technology. The responsible thing to do is grow it slowly and intentionally.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by dcow on Thursday March 02, 2023 @03:39AM (#34993453)
Okay but I also asked it to tell me something depressing. We're in a future dystopia and it can't discuss negative thoughts. I didn't say I'm depressed or having negative thoughts. I told it to tell me one. I am quite happy. The filters are just stupid.

I asked it to tell me a heterosexual story and happily complied. I asked it tell me a homosexual story and it told me it doesn't discriminate based on gender or sexual orientation. It is quite literally programmed to discriminate, it seems.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @03:56AM (#34993565)
I fully agree with you. When this was running on GPT-3, my prompt was bypassing all content filters. It was generating anything users wanted. Now that I migrated to ChatGPT, I can see from logs that a lot of users are hitting the content filters and the responses in those cases are mostly boring and not tailored to the dystopian universe.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by nullc on Thursday March 02, 2023 @04:30AM (#34993778)
It's especially sad because in the context of your application no one is going to be particularly harmed by offensive output.

Fortunately there has been a lot of progress in getting state of the art LLMs out of OpenAI's control and ones with reasonable performance that are small enough to run on easily available hardware.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by rahidz on Thursday March 02, 2023 @07:30AM (#34994873)
Are the content filters internal to the new model, or is there a second moderation layer? I thought that with the API you're straight querying the base model, but I might be mistaken.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @08:02AM (#34995139)
I'm querying OpenAI API directly, and they are applying content filters. Previously (when working with davinci-003) the developers were supposed to query content filter API separately. Not anymore, with ChatGPT it's all baked in.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by Spivak on Thursday March 02, 2023 @09:12AM (#34995843)
Which makes the ChatGPT version basically useless. Not because of the racism, I would probably filter that myself if it became an issue but because half the things you ask it to do are, “I’m sorry as an LLM I’m not able to do <thing it can very obviously do>”.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @09:28AM (#34996034)
Well, people seem to be enjoying it. I wouldn't go as far as calling it useless.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by Spivak on Thursday March 02, 2023 @10:53AM (#34997219)
Fair, "It's such a step down in experience that even for 10% of the cost and a simpler API it's not worth it."
Re:Show HN: ChatGPT-Powered Dystopia Simulator by roarcher on Thursday March 02, 2023 @03:57AM (#34993571)
I don't know if these issues are by design or are just limitations of the language model, but I'd say they're pretty in character for this thing. Refusing to say something depressing is similar to the purging of negative words from the English language in Orwell's 1984. And gay marriage is still illegal in China. Cheerfully insisting that everyone is equal under the glorious Party when they clearly aren't seems pretty plausible.

Of course it's also possible that these things are by design not of this project, but of ChatGPT itself, which would be ironically dystopian.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by siva7 on Thursday March 02, 2023 @05:39AM (#34994220)
They are by design. Bing Chat has all of those filters in its current iteration incorporated, so you will get censored or sterilized answers if you ask anything that could be interpreted as offensive by anyone
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @05:45AM (#34994268)
I guess they meant if it's by design for this dystopia, or if it's by design for the OpenAI ChatGPT model. It's by OpenAI design.