The point is that it's able to produce content that hasn't been made before, it's not just giving back examples from the training set. It's able to--yes, with instruction--combine concepts logically to produce something new.

If I ask a random person I meet to write a poem with the same instructions as were given above I'd be surprised if they were able to come up with something as good as ChatGPT.

So kinda like when your English teacher asks you to write a poem about whatever you want? Can't ChatGPT do that as well? There's at least novelty in whatever random content it generates, is there not? Just by having a large enough library you will create a new thing because nobody's been in the jakelope/unicorn area before, or whatever the dice decide. I feel like maybe there's something about this no-novelty argument, but it's not been worded in a convincing way yet.

By this logic, all my farts are novel content.

I just gave chatGPT the prompt "write a poem" and it gave me an original little ditty about nature.

The novelty was not in the prompt.