News for hackers. Stuff that matters.
Re:Are we racing toward AI catastrophe? by valine on Monday February 13, 2023 @09:52AM (#34774091)
There is evidence to suggest that LLMs have recently passed a threshold where their performance can be improved by training on their own output.

https://arxiv.org/abs/2210.11610

I expect your concerns are likely unwarranted.

Re:Are we racing toward AI catastrophe? by danaris on Monday February 13, 2023 @03:32PM (#34779965)
How does this do anything but validate their concerns?

They're not saying "if we train LLMs on their own output, they'll get slower or worse", they're saying "if we train LLMs on their own output, it gets even harder to actually derive sourcing for what they produce."