One can indeed argue that it’s not surprising – depending on your prior understanding of how Base64 works.

But for a person where both Base64 and LLMs are black boxes, then it can indeed be surprising.

To me, the most surprising thing about ChatGPT and other LLMs are the quality (despite all their flaws) and ther general applicability to a broad range of diverse tasks.