Re:The Unreasonable Effectiveness of an LLM Agent Loop with ...
by thorum on Thursday May 15, 2025 @05:08PM
(#43999358)
GPT 4.1 and 4o score very low on the Aider coding benchmark. You only start to get acceptable results with models that score 70%+ in my experience. Even then, don't expect it to do anything complex without a lot of hand-holding. You start to get a sense for what works and what doesn't.
https://aider.chat/docs/leaderboards/