Re:Collapse of Self-Trained Language Models
by juancn on Wednesday April 17, 2024 @02:45PM
(#40068624)
That, and we're constantly exposed to new information and situations.
The way to mimic it would be to self-train and add new crap onto the training continuously to simulate world experience, otherwise things get a bit too deterministic and you end up running an expensive minimization problem.
The way to mimic it would be to self-train and add new crap onto the training continuously to simulate world experience, otherwise things get a bit too deterministic and you end up running an expensive minimization problem.