We have almost run out of training data already so I’m not convinced they will get massively more generalised suddenly. If you give them reasoning tasks they haven’t seen before LLMs absolutely fall apart and produce essentially gibberish. They are currently search engines that give you one extremely good result that you can refine up to a point, they are not thinking even though there’s a little bit more understanding than search engines of the past.