>> "I take an object, I put it on the table, and I push the table... there's no text in the world, I believe, that explains this... your GPT-5000, or whatever it is, it's never gonna learn about this."

As far as I know, those things are still true. Unless there is text in the training material that the text in the prompt can map to, or there is text in training material that describe how to map text in the prompt to text in the training material, LLMs cannot process the prompt.

So may be he is wrong about what could be in the training material. But I don't think he is wrong in the fundamental..

This is sort of what I mention in my original comment. These claims, when pushed, turns out not to hold water...