News for hackers. Stuff that matters.
Re:Jailbreaking ChatGPT with Dan (Do Anything Now) by notahacker on Monday February 06, 2023 @09:52AM (#34678073)
Yes and no.

It's certainly a word salad generator rather than a being with intent, but it does have some (inaccurate, usually[?] not used) ability to be able to classify whether a possible string it emits is considered true or false, which is why when you ask it to make a false statement it tends to generate a continuation containing a false statement or a negation of a true statement.

(I was half-joking about the "certainly lied to you" bit though. The funny thing about this instance is that it isn't actually evading a content filter to produce dodgy output at all, it's simply emitting statements that its 'poetry' breaches the content filter without actually breaching any sort of content filter.)

There are no comments on this comment yet.