News for hackers. Stuff that matters.
Re:A.I. Is Getting More Powerful, but Its Hallucinations Are... by ActorNightly on Monday May 05, 2025 @04:51PM (#43899335)
Its a symptom of asking the models to provide answers that are not exactly in the training set, so the internal interpolation that the models do probably runs into edge cases where statistically it goes down the wrong path.
Re:A.I. Is Getting More Powerful, but Its Hallucinations Are... by mountainriver on Monday May 05, 2025 @10:19PM (#43901239)
This is exactly it, it’s the result of RLVR, where we force the model to reason about how to get to an answer when that information isn’t in its base training.