Actually they don't. You can listen to the podcasts by Lex Fridman with Yan Le Cun or Andrej Karpathy regarding that topic. But basically what Le Cun is saying is that the information density in text is not high enough in order to learn a realistic representation of the world from it.