News for hackers. Stuff that matters.
Re:Show HN: Run an Agent Council of LLMs that debate and syn... by BloodAndCode on Thursday March 12, 2026 @12:14PM (#47353071)
this is a really interesting direction. i've been experimenting with “self-critique” style pipelines (plan → solve → critique) and they often help smaller models punch above their weight. the agent council idea is also appealing, although the cost/latency trade-off usually becomes the tricky part when multiple models run in parallel.

curious how often the judge actually disagrees with the first candidate answer in practice. does the council mostly refine reasoning, or does it sometimes lead to completely different conclusions?

Re:Show HN: Run an Agent Council of LLMs that debate and syn... by JitseLambrichts on Friday March 13, 2026 @10:59AM (#47365384)
Great question. Currently, we don’t track a formal disagreement rate between the judge and candidate 1, so I can’t give a reliable percentage yet. By design, the judge synthesizes advisor outputs and is instructed not to introduce new ideas, which usually leads to refinement rather than completely new conclusions. That said, advisors run independently and can produce different lines of reasoning, so the judge can still diverge from candidate 1 when another advisor’s argument is stronger. This keeps the final output grounded in the council’s collective input rather than the judge acting as a standalone model.