News for hackers. Stuff that matters.
Re:A Bitter Lesson for Memory by wgd on Monday June 22, 2026 @08:17AM (#48629144)
I've always been amazed at how terrible most frontier LLMs are at compaction given how embarrassingly easy it is to come up with half a dozen different RL training evals which would teach models to generate useful context summaries. Heck, you could bolt it onto any existing RL eval by just forcing a compaction every three turns.
Re:A Bitter Lesson for Memory by wenhan_zhou on Monday June 22, 2026 @10:47AM (#48630942)
Yep. Or even better, compact after a random number of turns. The model must then learn to preserve useful context at arbitrary context lengths.