News for hackers. Stuff that matters.
Re:The unbearable slowness of AI coding by falcor84 on Thursday August 21, 2025 @03:02PM (#44976715)
> ... I’ll keep pulling PRs locally, adding more git hooks to enforce code quality, and zooming through coding tasks—only to realize ChatGPT and Claude hallucinated library features and I now have to rip out Clerk and implement GitHub OAuth from scratch.

I don't get this, how many git hooks do you need to identify that Claude had hallucinated a library feature? Wouldn't a single hook running your tests identify that?

Re:The unbearable slowness of AI coding by sc68cal on Thursday August 21, 2025 @03:06PM (#44976768)
They probably don't have any tests, or the tests that the LLM creates are flawed and not detecting these problems
Re:The unbearable slowness of AI coding by manmal on Thursday August 21, 2025 @04:18PM (#44977538)
Yesterday Claude Code assured me the following:

• Good news! The code is compiling successfully (the errors shown are related to an existing macro issue, not our new code).

When infact, it managed to insert 10 compilation errors that were not at all related with any macros.

Re:The unbearable slowness of AI coding by lkramer on Thursday August 21, 2025 @05:59PM (#44978605)
The other day I had Claude proudly proclaim it fixed the bug, by deleting log line that exposed the bug...
Re:The unbearable slowness of AI coding by AstroBen on Thursday August 21, 2025 @03:39PM (#44977110)
Just tell the AI "and make sure you don't add bugs or break anything"

Works every time

Re:The unbearable slowness of AI coding by deegles on Thursday August 21, 2025 @03:26PM (#44976963)
I tried using agents in Cursor and when it runs into issues it will just rip out the offending code :)
Re:The unbearable slowness of AI coding by robertfw on Thursday August 21, 2025 @08:43PM (#44979910)
I've had similar cases where the fix to the test was.. delete the test. Ah, if only I'd realized that little hack earlier in my career!
Re:The unbearable slowness of AI coding by loandbehold on Thursday August 21, 2025 @03:14PM (#44976864)
"hallucinated" library features are identified even earlier, when claude builds your project. i also don't get what author is talking about.
Re:The unbearable slowness of AI coding by pluto_modadic on Thursday August 21, 2025 @03:33PM (#44977046)
AI agents have been known to rip out mocks so that the tests pass.
Re:The unbearable slowness of AI coding by thrown-0825 on Thursday August 21, 2025 @04:05PM (#44977391)
I have had human devs do that too
Re:The unbearable slowness of AI coding by kiitos on Thursday August 21, 2025 @05:10PM (#44978141)
cool, can you think of any differences between a human engineer, who is presumably employed by an employer and subject to review and evaluation by a manager and inherently assumed to be capable of receiving feedback and reliably applying it on a go-forward basis to their future work, and an LLM, when they each make this same kind of mistake?
Re:The unbearable slowness of AI coding by cpursley on Thursday August 21, 2025 @06:46PM (#44979065)
Yes, the difference is about $197,600 of playing fair or $57,600 if offshoring.
Re:The unbearable slowness of AI coding by kiitos on Tuesday September 02, 2025 @04:13PM (#45108388)
the difference between an arbitrary LLM and a human engineer is completely described by the salary you would pay to the human engineer? in all other dimensions they are indistinguishable? nice, super cool
Re:The unbearable slowness of AI coding by thrown-0825 on Friday August 22, 2025 @01:55AM (#44981413)
yeah, when its a human its not a random chance and was them subverting testing and safety requirements to shortcut their way through their job.
Re:The unbearable slowness of AI coding by kiitos on Friday August 22, 2025 @04:46PM (#44989608)
nope not that
Re:The unbearable slowness of AI coding by jmvldz on Thursday August 21, 2025 @04:45PM (#44977857)
I don't have a ton of tests. From what I've seen, Claude will often just update the tests to no-op so tests passing isn't trustworthy.

My workflow is often to plan with ChatGPT and what I was getting at here is ChatGPT can often hallucinate features of 3rd party libraries. I usually dump the plan from ChatGPT straight into Claude Code and only look at the details when I'm testing.

That said, I've become more careful in auditing the plans so I don't run in to issues like this.

Re:The unbearable slowness of AI coding by CuriouslyC on Thursday August 21, 2025 @05:18PM (#44978220)
Tell Claude to use a code review sub agent after every significant change set, tell them to run the tests and evaluate the change set, don't tell Claude it wrote the code, and give them strict review instructions. Works like a charm.
Re:The unbearable slowness of AI coding by cpursley on Thursday August 21, 2025 @06:44PM (#44979041)
Any tips on writing productive review sub agent instruction?
Re:The unbearable slowness of AI coding by CuriouslyC on Thursday August 21, 2025 @06:54PM (#44979127)
Yes. Go on ChatGPT, explain what you're doing (claude code, trying to get it to be more rigorous with itself and reduce defects) then click deep research and tell it you'd like it to look up code review best practices, AI code review, smells/patterns to look out for in AI code, etc. Then have it take the result of that and generate a XML structured document with a flowchart of the code review best practices it discovered, cribbing from an established schema for element names/attributes when possible, and put it in fenced xml blocks in your subagent. You can also tell claude code to do deep research, you just have to be a little specific about what it should go after.
Re:The unbearable slowness of AI coding by jmvldz on Thursday August 21, 2025 @05:57PM (#44978584)
Interesting. I had not thought about a code review sub agent. I will give that a shot.