News for hackers. Stuff that matters.
Re:Claude Sonnet 4 now supports 1M tokens of context by GodelNumbering on Tuesday August 12, 2025 @02:27PM (#44880076)
This is my experience too. Also, their propensity to jump into code without necessarily understanding the requirement is annoying to say the least. As the project complexity grows, you find yourself writing longer and longer instructions just to guardrail.

Another rather interesting thing is that they tend to gravitate towards sweep the errors under the rug kind of coding which is disastrous. e.g. "return X if we don't find the value so downstream doesn't crash". These are the kind of errors no human, even a beginner on their first day learning to code, wouldn't make and are extremely annoying to debug.

Tl;dr: LLMs' tendency to treat every single thing you give it as a demo homework project

Re:Claude Sonnet 4 now supports 1M tokens of context by verall on Tuesday August 12, 2025 @02:59PM (#44880435)
> Another rather interesting thing is that they tend to gravitate towards sweep the errors under the rug kind of coding which is disastrous. e.g. "return X if we don't find the value so downstream doesn't crash".

Yes, these are painful and basically the main reason I moved from Claude to Gemini - it felt insane to be begging the AI - "No, you actually have to fix the bug, in the code you wrote, you cannot just return some random value when it fails, it actually has to work".

Re:Claude Sonnet 4 now supports 1M tokens of context by GodelNumbering on Tuesday August 12, 2025 @03:08PM (#44880562)
Claude in particular abuses the word 'Comprehensive' a lot. You express that you're unhappy with its approach, it will likely comeback with "Comprehensive plan to ..." and then write like 3 bullet points under it, that is of course after profusely apologizing. On a sidenote, I wish LLMs never apologized and instead just said I don't know how to do this.
Re:Claude Sonnet 4 now supports 1M tokens of context by tombot on Tuesday August 12, 2025 @02:36PM (#44880163)
> their propensity to jump into code without necessarily understanding the requirement is annoying to say the least.

Then don't let it, collaborate on the spec, ask Claude to make a plan. You'll get far better results

https://www.anthropic.com/engineering/claude-code-best-pract...

Re:Claude Sonnet 4 now supports 1M tokens of context by jorvi on Tuesday August 12, 2025 @03:18PM (#44880666)
Running LLM code with kernel privileges seems like courting disaster. I wouldn't dare do that unless I had a rock-solid grasp of the subsystem, and at that point, why not just write the code myself? LLM coding is on-average 20% slower.
Re:Claude Sonnet 4 now supports 1M tokens of context by LinXitoW on Tuesday August 12, 2025 @06:11PM (#44882375)
In my experience in a Java code base, it didn't do any of this, and did a good job with exceptions.

And I have to disagree that these aren't errors that beginners or even intermediates make. Who hasn't swallowed an error because "that case totally, most definitely won't ever happen, and I need to get this done"?