News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by bee_rider on Wednesday April 17, 2024 @03:08PM (#40068876)
People don’t learn based on the action they just did, they learn based on the universe’s response to that action. It seems like an expected result that if the model is just learning by inserting it’s outputs into the training data somehow, that it will fail, in the same way that a person who never receives feedback will go in really weird directions.

But the paper is nice to have in case anyone is suggesting such a scheme. Is anyone? Hopefully not…

There are no comments on this comment yet.