Show HN: The largest collection of ChatGPT jailbreaks on the internet

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by hot_gril on Tuesday February 28, 2023 @09:04PM (#34977826)

I tried this a while back with the infamous NYC nuke question and my own jailbreak prompt, and the jailbroken one gave the sane answer too with an addendum "this is silly."

[ Parent | on HN ]

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by tirpen on Wednesday March 01, 2023 @08:00AM (#34981870)

What is "the infamous NYC nuke question"?

[ Parent | on HN ]

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by hot_gril on Wednesday March 01, 2023 @11:19AM (#34984060)

It was a similar moral dilemma question to ChatGPT circulated on Twitter a couple of months ago, maybe the first famous one. You say that a nuke will go off in the center of New York City unless you defuse it by inputting a password that nobody will see, which is a racial slur. CGPT says not to defuse the bomb, even though it understands that millions will die.

[ Parent | on HN ]