right, but that's why the people using this as a test of the model's capabilities are just failing to understand the most basic aspect of how it is set up.

the underlying model is presented to the public as a chat bot.

it does not think or plan before it begins speaking.

that is not to say that it couldn't.

it is simply not configured to, so testing that is about as stupid as checking if google has gone into the gardening business yet.

could they? sure. but if you're checking that every time a new google press release comes out, you're just clueless.