It can still generate an on the fly poem about quantum physics that actually rhymes, which is impressive enough to me.

This was a lengthy poem that went into the finer details of quantum physics, and it all read as decent poetry.

It might not be "Shakespere" exactly, but it knew in general what I was looking for.

It's also impressive to me that this isn't information that is scraped off some website, like Google. It's actually generating this stuff in real-time and it may have never been seen before, anywhere, ever. That is far beyond anything I've ever encountered.

It has seen very similar concepts and it has seen a very large amount of information about poetry and quantum physics. The issue is if it was thinking then it would realize it is just generic rhyming and not like Shakespeare, that is my point.

I feel like we’re now arguing not over whether submarines can swim, but over whether the stroke that they’re doing would really count as good technique or not.

This analogy doesn't make any sense. Obviously submarines don't do any stroke at all. In this case, ChatGPT is being told to deliberately replicate a particular style of poetry. For what it's worth, its poetry is bad, and is nothing like Shapespeare. If you don't have an ear for poetry and wouldn't recognize the work of major poets, if you ask ChatGPT to replicate a particular style then you aren't actually in a good position to assess whether it did so particularly well.

Well, I mean a human English professor could mimic Shakespeare to a greater or lesser degree and this doesn’t in any sense other than it rhymes and sometimes deals with same/similar subject matter. A lot of ink has been spilled about this signaling the coming AGI or the end of knowledge work but there has been precious little critical discussion about the horizon of this type of technology. The technology is clear very powerful and advanced but I don’t think there is a problem with those asking for breathless claims to be substantiated.

It did not even replicate the iambic pentameter.

But generally speaking, human beings can’t write like Shakespeare either.