Certainly. I mean we've seen all 26 letters before-- ChatGPT is just remixing them.
How does one actually measure novelty, without having to know everything first?
The entire strength of large language models like GPT is that they do know a frighteningly good approximation of everything, in terms of having been trained on text written about it.
> And remixing stuff it has heard before is exactly what ChatGPT is doing.
Check out my "the confetti has left the cannon" example above.
https://news.ycombinator.com/item?id=35346683
Maybe still "remixing", but it sure feels like new to me.
And remixing stuff it has heard before is exactly what ChatGPT is doing. What it sucks at is the "feels like it's new" part, but fundamentally it would be quite easily capable of creating output that combines concepts with maximally negative correlation, the only thing that's truly missing is the ability to interpret the prompt as an instruction to do that.