News for hackers. Stuff that matters.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by strbean on Wednesday March 01, 2023 @01:31PM (#34986363)
My impression was that the quoted text is only a part of the pre-prompt. I've seen cases where ChatGPT gives a length in the order of thousands of words for the "conversation so far".

Here are a couple (questionable) sources indicating the pre-prompt is much longer:

https://www.reddit.com/r/ChatGPT/comments/zuhkvq/comment/j1k...

https://www.reddit.com/r/ChatGPT/comments/11ct5zd/chatgpt_re...

Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by skissane on Wednesday March 01, 2023 @11:03PM (#34991857)
> I've seen cases where ChatGPT gives a length in the order of thousands of words for the "conversation so far".

ChatGPT is notoriously unreliable at counting and basic arithmetic. So, I don't think the fact it makes such a claim is really evidence it is true.

> Here are a couple (questionable) sources indicating the pre-prompt is much longer:

They haven't shared what inputs they gave to get those outputs. Given ChatGPT's propensity to hallucination, how can we be sure those aren't hallucinated responses?