Re:AI models collapse when trained on recursively generated ...
by lumost on Wednesday July 24, 2024 @09:08PM
(#41063840)
The paper is interesting, but it seems to focus on iteratively training models on synthetic copies of the same data. Obviously, this is going to cause problems.
They did not address what happens if the model is trained on synthetic data that is distinct from the source corpus.
They did not address what happens if the model is trained on synthetic data that is distinct from the source corpus.