News for hackers. Stuff that matters.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by JCharante on Monday April 10, 2023 @03:33PM (#35516393)
In my experience GPT4 poorly performs ROT13 but can do base64 decoding really well. A lot of the early jailbreaks used base64 to sneak tokens into prompts. How could it base64 decode but not reverse a string? That's very odd.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by samus on Monday April 10, 2023 @05:01PM (#35517367)
My guess: Decoding Base64 is easy because it's a 1:1 mapping between strings. Since it's not supposed to be an encryption or obfuscation, there must be huge lookup tables somewhere on the internet that it uses as Rosetta stones.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by int_19h on Tuesday April 11, 2023 @07:28PM (#35533134)
The other thing is, it's trained on a lot of HTML, which includes data: URLs that decode to JS and SVG (on which it is also trained). So that one transformation is probably the one that is really baked well into the weights now.

BTW it doesn't just decode it, it also encodes it quite happily - in real time, as it is producing the output, sometimes unprompted. I once had GPT-4, when asked to produce SVG, produce it in form of an <img src="data:data:image/svg+xml;base64,..."> - and when I copy-pasted and rendered it, it was a valid SVG file with shapes inside.