Re:Sonnet 5.5
by wahnfrieden on Monday September 28, 2026 @10:10PM
(#49887232)
Iām seeing hundreds of review loops before settling, with Astra/Sol
Re:Sonnet 5.5
by gchamonlive on Tuesday September 29, 2026 @07:17AM
(#49891320)
Could come down to the different nature of the work you guys do.
Re:Sonnet 5.5
by senderista on Monday September 28, 2026 @10:14PM
(#49887263)
Astra is less nitpicky IME than Fable.
There was also a period where specifically OpenAI models would always have to comment something in code review and the builders were agreeable up to listening to each nitpick. If you'd have a loop of build->review->build->review, it would take maybe 5-7 rounds for it to 'settle' and not find the smallest nitpicks to argue about. Tried it this week with Astra reviewer and it's about 0-2 review loops (never had a LLM accept a change without nitpicking first try before Astra).
There was also a period where you'd have to give quite specific instructions for agents to keep iterating, but now agent are pretty proactive and try to finish tasks you give them unsurprisingly most of the time.
So, while there's a shortcoming of LLM+harness and engineers observe more tokens improve things even logarithmicly, you'll see more tokens seemingly abused by engineers.