I think that since SEO and corporate blogging will use ChatGPT to generate content that they think will move sites up in the rankings, LLMs will end up being trained on rubbish. There will be a feedback loop, and later generations of LLMs will experience something analogous to "heterodyning".