News for hackers. Stuff that matters.
Re:Claude Sonnet 4 now supports 1M tokens of context by ehnto on Tuesday August 12, 2025 @11:27PM (#44884395)
Additionally, the more information you put into the context the more confused the LLM will get, if you did dump the whole codebase into the context it would not suddenly understand the whole thing. It is still an LLM, all you have done is polluted the context with a million lines of unrelated code, and some lines of related code, which it will struggle to find in the noise (in my experience of much smaller experiments)
Re:Claude Sonnet 4 now supports 1M tokens of context by Bombthecat on Wednesday August 13, 2025 @05:41AM (#44886394)
I call this context decay. :)

The bigger the context, the more stuff "decays" sometimes to complete different meanings