News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by simonw on Monday June 02, 2025 @06:10PM (#44163688)
Why does that seem weak to you?

It seems obviously true to me: code hallucinations are where the LLM outputs code with incorrect details - syntax errors, incorrect class methods, invalid imports etc.

If you have a strong linter in a loop those mistakes can be automatically detected and passed back into the LLM to get fixed.

Surely that's a solution to hallucinations?

It won't catch other types of logic error, but I would classify those as bugs, not hallucinations.

Re:My AI skeptic friends are all nuts by slg on Monday June 02, 2025 @06:23PM (#44163812)
>It won't catch other types of logic error, but I would classify those as bugs, not hallucinations.

Let's go a step further, the LLM can produce bug free code too if we just call the bugs "glitches".

You are making a purely arbitrary decision on how to classify an LLM's mistakes based on how easy it is to catch them, regardless of their severity or cause. But simply categorizing the mistakes in a different bucket doesn't make them any less of a problem.

Re:My AI skeptic friends are all nuts by layer8 on Monday June 02, 2025 @06:52PM (#44164128)
I don’t see why an LLM wouldn’t hallucinate project requirements or semantic interface contracts. The only way you could escape that is by full-blown formal verification and specification.
Re:My AI skeptic friends are all nuts by ofjcihen on Monday June 02, 2025 @06:16PM (#44163753)
A good example of where a linter wouldn’t work is when the LLM has you import a package that doesn’t exist.
Re:My AI skeptic friends are all nuts by jonas21 on Tuesday June 03, 2025 @12:06AM (#44166158)
It'll run it through the type checker, it will fail, and the LLM will go off and fix it (all without user intervention).