Re:Principles for production AI agents
by colonCapitalDee on Monday July 28, 2025 @06:52PM
(#44716714)
The problem isn't that LLMs can't be critical, it's that LLMs don't have taste. It's easy to get an LLM to give praise, and it's easy to get an LLM to give criticism, but getting an LLM to praise good things and criticize bad things is currently impossible for non-trival inputs. That's not say that prompting your LLM to generate criticism is useless, it's just that any LLM prompted to generate criticism is going to criticize things are that actually fine, just like how an LLM prompted to generate praise (which is effectively the default behavior) is going to praise things that are deeply not fine.
Re:Principles for production AI agents
by bubblyworld on Tuesday July 29, 2025 @02:30AM
(#44719770)
Absolutely matches my experience - it can still be super helpful, but AI have an extreme version of an anchoring bias.
Another issue is that the behaviour of the LLMs is not very consistent.
Now granted, you could say it was “flattering that instruction”, but it sure didn’t flatter me. It absolutely eviscerated my code, calling out numerous security issues (which were real), all manner of code smells and bad architectural decisions, and ended by saying that the codebase appeared to have been thrown together in a rush with no mind toward future maintenance (which was… half true… maybe more true than I’d like to admit).
All this to say that it is far from obvious that LLMs are intrinsically bad critics.