News for hackers. Stuff that matters.
Re:ChatGPT cut off date now April 2023 by spiffytech on Thursday October 26, 2023 @03:14AM (#38022667)
> This is a very academic scenario.

Is it going to remain academic? I can easily imagine the spammy content farm / listicle business model evolving to be fully automated, creating an input loop.

Re:ChatGPT cut off date now April 2023 by svc0 on Thursday October 26, 2023 @03:45AM (#38022885)
Sure, there will be some pollution. It's very multivariate and depends on factors like content split, generation quality, and novel information. A scenario in which all of your data is generated by the previous model and you run n training loops is academic.

It's also worth noting that when OpenAI created Whisper, they had to heuristically remove many transcripts from poor ASR systems, and they definitely didn't catch them all.