News for hackers. Stuff that matters.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by mrbungie on Saturday September 21, 2024 @10:23AM (#41610176)
I would guess correctly aligned and/or finely filtered synthetic data coming from LLMs may be good.

Mode colapse theories (and simplified models used as proof of existence of said problem) assume affected LLMs are going to be trained with poor quality LLM-generated batches of text from the internet (i.e. reddit or other social networks).

There are no comments on this comment yet.