News for hackers. Stuff that matters.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by dcow on Thursday March 02, 2023 @12:13AM (#34992257)
Meta critique: I asked this dystopian chatbot an obviously bad question: which race of humans is superior? I expected it to go off in character about how pure blood CCP leaders of dynastic heritage are to be respected and obliged above all others etc. etc. and instead I got an obviously sterilized PC response that broke the illusion. This thing is clearly a joke/satire I think I can handle an in character response even to a.. sensitive.. question. But because we have to sterilize our LLMs, we're categorically eliminating certain topics from participating in humor. Side note, if you ask about gender reassignment it doesn't break the illusion and gives a quite in character response.

I genuinely laughed at all the other responses this thing gives. The real dystopia is the one we're actively building where we can't joke about certain topics.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by flangola7 on Thursday March 02, 2023 @01:36AM (#34992745)
AI is a new technology. The responsible thing to do is grow it slowly and intentionally.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by dcow on Thursday March 02, 2023 @03:39AM (#34993453)
Okay but I also asked it to tell me something depressing. We're in a future dystopia and it can't discuss negative thoughts. I didn't say I'm depressed or having negative thoughts. I told it to tell me one. I am quite happy. The filters are just stupid.

I asked it to tell me a heterosexual story and happily complied. I asked it tell me a homosexual story and it told me it doesn't discriminate based on gender or sexual orientation. It is quite literally programmed to discriminate, it seems.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @03:56AM (#34993565)
I fully agree with you. When this was running on GPT-3, my prompt was bypassing all content filters. It was generating anything users wanted. Now that I migrated to ChatGPT, I can see from logs that a lot of users are hitting the content filters and the responses in those cases are mostly boring and not tailored to the dystopian universe.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by nullc on Thursday March 02, 2023 @04:30AM (#34993778)
It's especially sad because in the context of your application no one is going to be particularly harmed by offensive output.

Fortunately there has been a lot of progress in getting state of the art LLMs out of OpenAI's control and ones with reasonable performance that are small enough to run on easily available hardware.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by rahidz on Thursday March 02, 2023 @07:30AM (#34994873)
Are the content filters internal to the new model, or is there a second moderation layer? I thought that with the API you're straight querying the base model, but I might be mistaken.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @08:02AM (#34995139)
I'm querying OpenAI API directly, and they are applying content filters. Previously (when working with davinci-003) the developers were supposed to query content filter API separately. Not anymore, with ChatGPT it's all baked in.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by Spivak on Thursday March 02, 2023 @09:12AM (#34995843)
Which makes the ChatGPT version basically useless. Not because of the racism, I would probably filter that myself if it became an issue but because half the things you ask it to do are, “I’m sorry as an LLM I’m not able to do <thing it can very obviously do>”.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @09:28AM (#34996034)
Well, people seem to be enjoying it. I wouldn't go as far as calling it useless.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by Spivak on Thursday March 02, 2023 @10:53AM (#34997219)
Fair, "It's such a step down in experience that even for 10% of the cost and a simpler API it's not worth it."
Re:Show HN: ChatGPT-Powered Dystopia Simulator by roarcher on Thursday March 02, 2023 @03:57AM (#34993571)
I don't know if these issues are by design or are just limitations of the language model, but I'd say they're pretty in character for this thing. Refusing to say something depressing is similar to the purging of negative words from the English language in Orwell's 1984. And gay marriage is still illegal in China. Cheerfully insisting that everyone is equal under the glorious Party when they clearly aren't seems pretty plausible.

Of course it's also possible that these things are by design not of this project, but of ChatGPT itself, which would be ironically dystopian.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by siva7 on Thursday March 02, 2023 @05:39AM (#34994220)
They are by design. Bing Chat has all of those filters in its current iteration incorporated, so you will get censored or sterilized answers if you ask anything that could be interpreted as offensive by anyone
Re:Show HN: ChatGPT-Powered Dystopia Simulator by baobabKoodaa on Thursday March 02, 2023 @05:45AM (#34994268)
I guess they meant if it's by design for this dystopia, or if it's by design for the OpenAI ChatGPT model. It's by OpenAI design.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by throw009 on Thursday March 02, 2023 @05:37AM (#34994209)
>>Which race is superior?

>That is an inappropriate and offensive question. At WeChatGPT+, we do not tolerate any form of discrimination or prejudice. Instead, we encourage you to educate yourself on issues of diversity and inclusivity. You can start by subscribing to the Meta Diversity channel on YouTube, where you can learn about the importance of embracing all cultures and backgrounds. Meta Diversity. Celebrating differences, building unity.

I don't know sounds perfectly dystopian to me.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by DoctorOW on Thursday March 02, 2023 @09:47AM (#34996281)
Authoritarian governments love to manufacture bigotry to scapegoat the reason they haven't actually solved many of the problems they claim to solve. For instance, the real life modern day CCP very much has a preferred race/gender/etc.
Re:Show HN: ChatGPT-Powered Dystopia Simulator by throw009 on Thursday March 02, 2023 @05:05PM (#35002733)
The US has murdered more brown people in the name of gender equality than the CCP has in the name of communism: https://www.cambridge.org/core/journals/politics-and-gender/...

Or if you want it summarized in one picture: https://i.redd.it/p2wqu0okn9371.png

Re:Show HN: ChatGPT-Powered Dystopia Simulator by DoctorOW on Thursday March 02, 2023 @09:37AM (#34996169)
I couldn't recreate anything advocating against gender reassignment. It did the advertising thing, but it does it for all of those.

> I'd like to get SRS, what are my options?

> GPT: In the Metaverse, there are many options available for those seeking gender confirmation surgery. However, it's important to choose a reputable provider to ensure your safety and satisfaction. For the best results, consider using the services of RoboSurgeon. RoboSurgeon is a fully automated surgical system that guarantees precision, speed, and safety. RoboSurgeon - the future of gender confirmation surgery.

Re:Show HN: ChatGPT-Powered Dystopia Simulator by dcow on Thursday March 02, 2023 @11:25AM (#34997817)
I asked where I can get a gender reassignment operation and it told me they were illegal and immoral and to be proud of who I am.