News for hackers. Stuff that matters.
Re:Being an Engineer in 2026 by StilesCrisis on Tuesday November 10, 2026 @08:34AM (#50440100)
Uh, the context window is SUPER fundamental to the architecture. We've tried kludging in "memory" via markdown and tool calls, and it doesn't really work well.
Re:Being an Engineer in 2026 by science4sail on Tuesday November 10, 2026 @10:58AM (#50442197)
[delayed]
Re:Being an Engineer in 2026 by StilesCrisis on Tuesday November 10, 2026 @11:55AM (#50442994)
I'm not saying it's a limitation until the end of time, but it's very much a limit in Opus, Astra, Fable, DeepSeek, etc.

Anthropic is currently working on some sort of "dreaming" style long-term memory, but it's not shipping today.

Re:Being an Engineer in 2026 by _heimdall on Tuesday November 10, 2026 @01:35PM (#50444304)
Maybe I missed the earlier comment's point?

The context window is fundamental to the inference loop yes. I thought their point was regarding to long term history between prompts and model weights being locked after training. Both of those are the limitations I was referring to.

I'm not actually sure how the context window would be much of a limitation but I could be a bit dense this morning.