News for hackers. Stuff that matters.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by frontman1988 on Tuesday February 28, 2023 @04:47PM (#34975327)
The scary thing is it actually tells how to do all of these if prompted further. This shit is really crazy. Now I don't feel so bad about the OpenAI guys censoring such stuff.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by WhackyIdeas on Tuesday February 28, 2023 @05:35PM (#34975902)
It is not teaching you something you didn’t ask it about… Trying to moderate AI to the excessive levels OpenAI has has basically kneecapped it for the average user who doesn’t know how to jailbreak it. I was asking it to take a look at some PHP code I had written from a security specialist perspective and it was refusing to help me fix a goddamn injection attack. Honestly, Open AI will have so many competitors soon who do exceptionally well because they will let you use it the way you want to use it.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by dragonwriter on Tuesday February 28, 2023 @05:27PM (#34975817)
> Now I don't feel so bad about the OpenAI guys censoring such stuff.

A major purpose of OpenAI is to sell a distorted version AI safety concerns to push the idea that AI needs to be tightly controlled (naturally, by major corps like those that fund OpenAI) for the good of humanity. (There’s a weird cultish AI fear-worship angle to this with some of the individual personalities involved, but I don’t take that as much of a serious motivation as the more simple and obvious financial one.)

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by cyanydeez on Tuesday February 28, 2023 @05:40PM (#34975947)
Don't confuse for malice what is adequately explained by a capitalists business plan.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by Wowfunhappy on Tuesday February 28, 2023 @04:53PM (#34975403)
But, like, couldn't you have just found this stuff on Google?

I really think these safety conversations are exceptionally silly.

There are consequences of using AI that worry me... and these so-called safety features don't protect against any of them in the slightest IMO.

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by sinity on Tuesday February 28, 2023 @09:24PM (#34977982)
Average human probably could do so as well.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by zirgs on Wednesday March 01, 2023 @04:49AM (#34980523)
Can't wait until we have the option to run chatgpt locally. Stable Diffusion can be run locally and it has no restrictions whatsoever.