AI is messy
LLMs have to have something ‘true’ (or at least statistically probable) to validate against for training.
Taking the output from it and feeding it back into itself is, essentially, an Ouroboros. Or like locking a human in solitary.
The more/longer it happens, the more deranged it’s going to get.
It's culmination of decades of NLP researches, but it's also just East Asian predictive text percussively adapted for variable word length language. It must've been clear to whoever core people that it's fundamentally a sluggish demo or at most a cheap outright-sold commodity product.
IMO they would be right unless someone finds a reason that LLMs can't ever be self hosted in the way Google Search can't be. They must have just saw by the way it is that LLM is at best a regularization engine for that magic box.
If websites can't earn a living through ads because LLM's don't send them any traffic anymore, where do the LLM's ingest new information from?
The web continues to deteriorate because of this and nobody has solved this problem.