News for hackers. Stuff that matters.
Re:AI Is Stifling Tech Adoption by xmprt on Friday February 14, 2025 @03:32PM (#43052784)
Attention works better on smaller contexts since there's less confounding tokens so even if the LLM can see the entire context, it's better to keep the amount of confounding context lower. And at some point the source code will exceed the size of the context window; even the newer ones will millions of tokens of context can't hold the entirety of many large codebases.
Re:AI Is Stifling Tech Adoption by baq on Friday February 14, 2025 @03:47PM (#43052907)
Of course, but OP’s 1kloc is nowhere near close to any contemporary limit. Not using the tool for what it’s designed because it isn’t designed for a harder problem is… unwise.