Re:Anthropic IPO
by orwin on Thursday November 12, 2026 @01:39PM
(#50472049)
> Theres also the idea of LLMs producing synthetic data to contribute to new models. Perhaps that is not as effective as hoped.
Wasn't model collapse/model decay a big issue since the beginning? i know that RL kinda mitigate the effect, but if this was close to not be an issue anymore, wouldn't we have a paper on that already? All that i've seen on the subject was about mitigation, never about solving the issue.
Sorry if my question is dumb, I need to do some research about the difference between image generator and text generator, i feel like my understanding of LLM is skewed by my usage and understanding of Z-turbo, but i only have that much time in my week.
Wasn't model collapse/model decay a big issue since the beginning? i know that RL kinda mitigate the effect, but if this was close to not be an issue anymore, wouldn't we have a paper on that already? All that i've seen on the subject was about mitigation, never about solving the issue.
Sorry if my question is dumb, I need to do some research about the difference between image generator and text generator, i feel like my understanding of LLM is skewed by my usage and understanding of Z-turbo, but i only have that much time in my week.