Why is it nonsense exactly?
they run one batch at a time, only when executed, with functionally no memory.
If, for some reason, you gave it a context about being shut down it would 'forget' after you asked it to produce a rude limerick about aardvarks three times.
“Functionally no memory” is a funny way of saying 1 million tokens of memory
That's A) not actually a lot B) not generally kept between sessions
B is not universally true, premium versions of chat agents keep data between sessions. A is only true in the case where B is true, which it is not.
https://community.openai.com/t/chatgpt-can-now-reference-all...
Nonsense seems like a strong word for "not generally possible in like 75% of the cases that people use chat AI today"
It's also nonsensical if you think for even one second about the way the program actually runs though.