Future AI doesn't have to be trained on text, it doesn't need to be a language model. It can be trained on video data to predict its sensory inputs. It would predict the future of reality, not the next text tokens. Gains from training on text are bound by the human intelligence which produced this text. But training on sensory data is only bound by reality itself.