News for hackers. Stuff that matters.
Re:Irrelevant facts about cats added to math problems increa... by grej on Tuesday July 29, 2025 @09:32PM (#44730167)
Related to this, is anyone aware whether there is a benchmark on this kind of thing - maybe broadly the category of “context rot”? To track things that are not germane to the current question adversely affecting the responses, as well as the volume of germane but deep context creating the inability of models to follow the conversation? I’ve definitely experienced the latter with coding models.
Re:Irrelevant facts about cats added to math problems increa... by energy123 on Tuesday July 29, 2025 @10:06PM (#44730322)
In computer vision they add noise to the picture when training. Maybe LLM providers should do the same during RL.
Re:Irrelevant facts about cats added to math problems increa... by nijave on Tuesday July 29, 2025 @09:36PM (#44730181)
Not sure but sounds like a very similar problem to prompt injection