The current culture about AI & LLMs is that we are "only" memorizing the Web into model parameters and that a LLM is unable to "invent" new paradigms. Maybe we are under estimating what Unsupervised Learning & RL could provide. Re-inforcement learning is about exploring and finding new ways to accomplish a task and I see no limit here (except the computational resources needed).