Re:Building a Multi-Agent System from Scratch: Architecture ...
by bob1029 on Thursday November 05, 2026 @11:45AM
(#50381328)
Sub agents are significantly more useful than multi agents.
Wrap a nested prompt with a tool call that is invoked by the caller prompt. That is the answer to all your suffering. You can repeat this for as many layers of invocation as you desire. You can layer determinism and non-determinism as much as you like in whatever orders you see fit with additional alignment, retry policies, logging, etc.
Agents running concurrently will not go any faster than one well-designed hierarchical agent system.
Imagine the simple task of incrementing a global counter. That would be my #1 benchmark. If you can demonstrate a MAS can increment that counter faster than a single agent can (monotonically without skipping), then I will happily delete 100% of the AI-related code I've authored and start over using your ideas.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by gbnwl on Thursday November 05, 2026 @12:27PM
(#50381803)
What harness are you using? In both Claude Code and Codex I run into the issue of subagents being unable to dispatch their own subagents, so I haven't been able to play with "many layers of invocation".
Re:Building a Multi-Agent System from Scratch: Architecture ...
by mickeyp on Friday November 06, 2026 @02:26AM
(#50389244)
You can do this trivially in dreamcoder.ai.
Build the sub agent to your specification (prompt, how the parent agent should call it); give it tools and optionally skills; then give it permission to call some or all the other sub agents you have set up.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by KellyCriterion on Thursday November 05, 2026 @12:03PM
(#50381540)
TBH, this one is an example of the rather good bucket, Id say?
I have seen much much worse examples on corporate blogs for example, where I question if authors even understand how to use any publishing system and how colors & info architecture works :-D
Re:Building a Multi-Agent System from Scratch: Architecture ...
by mtrovo on Thursday November 05, 2026 @07:01PM
(#50386347)
The more I see these daily slop posts, the more I wish it were more common to dump your conversation transcript with your slop post with an option to jump in with my own live LLM session and a Socratic persona where I figure out by questioning what exactly the author thought this was worth posting about.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by randysalami on Friday November 06, 2026 @07:34AM
(#50391613)
I think most people’s conversations in these slop mines would show a lack of depth and undermine what image they are trying to portray. I do agree though. I’m always happy to show my transcripts. Usually they show the gap between someone experienced and inexperienced rather than the opposite.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by empath75 on Thursday November 05, 2026 @12:26PM
(#50381791)
If you leave "The Honest Summary" in anything Claude wrote, I am not going to read any of it, shows a complete lack of care or interest in what you are doing.
I don't care if you are having Claude write something for you, but I feel like I spent more time writing these two sentences than this person put into this post.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by scubbo on Thursday November 05, 2026 @01:35PM
(#50382685)
My opinion has shifted over the last few months. Instead of valuing effort put into "putting words together", I am trying to judge the value that I get _from_ the words[0].
I'm reminded of a passage in Stephen Fry's "The Liar"[1], which draws the distinction between a book as an object of art, and a book as a vehicle for communication. If the message is worthwhile, I don't care if it was blurted out by a model or if blind monks inscribed it by hand into vellum parchment.
Don't get me wrong, there's certainly correlation - if I _know_ you've taken a lot of effort to write something, the chances are good that there is worthwhile content being communicated. But the correlation is _not_ perfect.
[0] when it comes to technical writing that intends to communicate information. Narrative writing that intends to evoke an emotion or viewpoint is a different story!
Re:Building a Multi-Agent System from Scratch: Architecture ...
by ClaraForm on Thursday November 05, 2026 @02:19PM
(#50383200)
The problem is there's no signal for the recipient that the value being delivered aligns with the intention of the human who set the prompting chain into action, right?
If an AI auto-outputs something with no sign of final check-off by a human, we don't even know if the intention of the human is to spam 100 different articles and delete 99 based on perceived success, or if the AI actually helped them translate something worth saying.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by whartung on Thursday November 05, 2026 @07:31PM
(#50386599)
> The problem is there's no signal for the recipient that the value being delivered aligns with the intention of the human who set the prompting chain into action, right?
Don’t you think that the fact that the person put their name on it and published it carries some weight as to the congruence of what the person wanted to convey and text of the article itself?
We don’t even know what iterations, granted, if any, were performed on the article text before it was published.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by scubbo on Thursday November 05, 2026 @08:22PM
(#50386981)
> Clear intention is also an indicator of value
Genuine question - is it? Why? If I set out to write a mediocre guide to bicycle maintenance, and through a spectacular series of typos I accidentally write a recipe for a sublime cheesecake, it's still true that I've written a good recipe, even if that wasn't my intent.
(Hopefully we can bypass quibbling about the use of the term "write" in an LLM-assisted context. Readers should feel free to substitute the clunkier phrase "take actions that cause words to be recorded" if they wish)
> It's [...] very difficult to figure out where to "listen"
I don't agree. Or rather, I don't think it's any harder than it has been since the Internet exploded, long before LLMs. It's just based on track record. Read an article; note that it's useful; note the source. See another article by that source; find it useful again; begin to attribute trust to them. Read a less-good article by them; lessen your trust somewhat.
By all means, observe "this person probably didn't edit this after an LLM generated it" and take that as an input to whether you will trust their observations - but you should probably be verifying anything technical that you read anyway. If you consistently observe unhelpful or misleading content from a particular source, you should stop trusting it, regardless of whether that content was human- or AI-generated.
> If an author doesn't try to make "listening" easier, then it puts the value they hold into question if they don't care about it enough themselves.
Again, I don't think that's true. If someone has tweaked and moulded an LLM-content-generation pipeline such that they can generate a piece of technical content that is still genuinely-useful even without a human editing pass to reduce LLM-isms, they're still a useful source. I might justifiably think they're lazy, uninvested, or not an expert in the domain - but it would be foolish to deny the usefulness of their output.
To put it differently - Michael Jordan could wake up hungover and, with one hand behind his back, still kick my ass at basketball. The fact that he's not trying the hardest he could doesn't mean that the scoreboard would be any less valid. Equivalently, caring about the content you create doesn't directly affect the value of what you create (again, I can't stress enough - for technical content only!) - it's probably positively correlated (because it will cause you to take more care), but _not_ a prerequisite.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by brkomir on Thursday November 05, 2026 @02:47PM
(#50383531)
I usually run 4-5 claude sessions in parallel on the same branch, each with its own working plan or work item. They coordinate almost in real time, leaving messages in a shared queue and picking them up every 30 seconds. What keeps them from stepping over each other's work is a commit script that allows only staged changes from one session to be committed at a time.
Where it actually pays off to have separate sessions is the code review. Every code change that affects how the app behaves is checked by a session that didn't write the change. Some numbers: 4,454 verdicts on 4,471 commits since September. About four in five first reviews found something, and about half asked for changes.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by UncleOxidant on Thursday November 05, 2026 @07:43PM
(#50386701)
Interesting. I'd like to have something where I'm primarily running a local model - Qwen3.8-Flash-Next - and then have it consult with a frontier model as an "advisor" - like how you can setup an advisor model in Claude code.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by leobg on Friday November 06, 2026 @01:15PM
(#50396095)
> They coordinate almost in real time, leaving messages in a shared queue and picking them up every 30 seconds. What keeps them from stepping over each other's work is a commit script that allows only staged changes from one session to be committed at a time.
You wrote that as a skill or hook or something? I do notice that sessions have knowledge of other sessions, but what you’re describing sounds more formalized and enforced.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by brkomir on Sunday November 08, 2026 @01:58PM
(#50415956)
A hook plus a background script. The hook tells the session to arm the background script (mail-listener) that check every 30 seconds for anything addressed to it or the entire fleet, using Calude Code’s Monitor tool.
The mailbox is a file-based message queue I’ve been using since June. It can broadcast to every session at once, it holds mail for up to 72 hours, and the messages stay on disk as a record. Claude Code added its own cross-session messaging in the meantime, but I still use my own because of the differences.
For example, the most heavy daily use is for code reviews. Session A writes the code -> dedicated review session reviews it -> Session A fixes the findings or challenges some -> the reviewer runs another round. The loop is closed once every finding is fixed or tracked in todo/backlog (as long as it’s not high or critical severity).
The commit part is a script that refuses any staged file that isn't the committing session's own.
It’s my own design and it's open source if you want to look and play around. I'd appreciate your feedback! https://github.com/brkomir/anja
Re:Building a Multi-Agent System from Scratch: Architecture ...
by 1shooner on Thursday November 05, 2026 @06:33PM
(#50386114)
This is probably my own bias, but the Claudlish in that slide deck is throwing me off. There's just part of my learner brain that can't take it seriously if you can't write your own headings.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by latentsea on Friday November 06, 2026 @10:49PM
(#50401443)
It's an off-putting slop tell. I think those of us whose job involves reading AI generated outputs virtually all day long have developed an aversion to these types of things that's partially related to burnout and partially related to the availability bias of how many times a day we find and correct AI mistakes.
My brain just defaults to "there is something wrong with this" as a result.
Re:Building a Multi-Agent System from Scratch: Architecture ...
by beardbandit on Friday November 06, 2026 @11:11AM
(#50394242)
Is it just me or are many of these things just common sense to someone that has designed systems before?
I’ve found zero help with many of these AI-related blogs and articles. The only novel ones that actually turn into anything actionable or insightful are the first party articles from the frontier companies themselves…
Wrap a nested prompt with a tool call that is invoked by the caller prompt. That is the answer to all your suffering. You can repeat this for as many layers of invocation as you desire. You can layer determinism and non-determinism as much as you like in whatever orders you see fit with additional alignment, retry policies, logging, etc.
Agents running concurrently will not go any faster than one well-designed hierarchical agent system.
Imagine the simple task of incrementing a global counter. That would be my #1 benchmark. If you can demonstrate a MAS can increment that counter faster than a single agent can (monotonically without skipping), then I will happily delete 100% of the AI-related code I've authored and start over using your ideas.
Build the sub agent to your specification (prompt, how the parent agent should call it); give it tools and optionally skills; then give it permission to call some or all the other sub agents you have set up.
Easy-peasy.
I have never see a case where I need multi-agents talking to each others or something
I have seen much much worse examples on corporate blogs for example, where I question if authors even understand how to use any publishing system and how colors & info architecture works :-D
I don't care if you are having Claude write something for you, but I feel like I spent more time writing these two sentences than this person put into this post.
I'm reminded of a passage in Stephen Fry's "The Liar"[1], which draws the distinction between a book as an object of art, and a book as a vehicle for communication. If the message is worthwhile, I don't care if it was blurted out by a model or if blind monks inscribed it by hand into vellum parchment.
Don't get me wrong, there's certainly correlation - if I _know_ you've taken a lot of effort to write something, the chances are good that there is worthwhile content being communicated. But the correlation is _not_ perfect.
[0] when it comes to technical writing that intends to communicate information. Narrative writing that intends to evoke an emotion or viewpoint is a different story!
[1] https://blog.scubbo.org/posts/books-as-vehicles/
If an AI auto-outputs something with no sign of final check-off by a human, we don't even know if the intention of the human is to spam 100 different articles and delete 99 based on perceived success, or if the AI actually helped them translate something worth saying.
We don’t even know what iterations, granted, if any, were performed on the article text before it was published.
Genuine question - is it? Why? If I set out to write a mediocre guide to bicycle maintenance, and through a spectacular series of typos I accidentally write a recipe for a sublime cheesecake, it's still true that I've written a good recipe, even if that wasn't my intent.
(Hopefully we can bypass quibbling about the use of the term "write" in an LLM-assisted context. Readers should feel free to substitute the clunkier phrase "take actions that cause words to be recorded" if they wish)
> It's [...] very difficult to figure out where to "listen"
I don't agree. Or rather, I don't think it's any harder than it has been since the Internet exploded, long before LLMs. It's just based on track record. Read an article; note that it's useful; note the source. See another article by that source; find it useful again; begin to attribute trust to them. Read a less-good article by them; lessen your trust somewhat.
By all means, observe "this person probably didn't edit this after an LLM generated it" and take that as an input to whether you will trust their observations - but you should probably be verifying anything technical that you read anyway. If you consistently observe unhelpful or misleading content from a particular source, you should stop trusting it, regardless of whether that content was human- or AI-generated.
> If an author doesn't try to make "listening" easier, then it puts the value they hold into question if they don't care about it enough themselves.
Again, I don't think that's true. If someone has tweaked and moulded an LLM-content-generation pipeline such that they can generate a piece of technical content that is still genuinely-useful even without a human editing pass to reduce LLM-isms, they're still a useful source. I might justifiably think they're lazy, uninvested, or not an expert in the domain - but it would be foolish to deny the usefulness of their output.
To put it differently - Michael Jordan could wake up hungover and, with one hand behind his back, still kick my ass at basketball. The fact that he's not trying the hardest he could doesn't mean that the scoreboard would be any less valid. Equivalently, caring about the content you create doesn't directly affect the value of what you create (again, I can't stress enough - for technical content only!) - it's probably positively correlated (because it will cause you to take more care), but _not_ a prerequisite.
This agent for Claude is called explore. https://code.claude.com/docs/en/sub-agents
It returns only a summary.
Where it actually pays off to have separate sessions is the code review. Every code change that affects how the app behaves is checked by a session that didn't write the change. Some numbers: 4,454 verdicts on 4,471 commits since September. About four in five first reviews found something, and about half asked for changes.
You wrote that as a skill or hook or something? I do notice that sessions have knowledge of other sessions, but what you’re describing sounds more formalized and enforced.
The mailbox is a file-based message queue I’ve been using since June. It can broadcast to every session at once, it holds mail for up to 72 hours, and the messages stay on disk as a record. Claude Code added its own cross-session messaging in the meantime, but I still use my own because of the differences.
For example, the most heavy daily use is for code reviews. Session A writes the code -> dedicated review session reviews it -> Session A fixes the findings or challenges some -> the reviewer runs another round. The loop is closed once every finding is fixed or tracked in todo/backlog (as long as it’s not high or critical severity).
The commit part is a script that refuses any staged file that isn't the committing session's own.
It’s my own design and it's open source if you want to look and play around. I'd appreciate your feedback! https://github.com/brkomir/anja
Lecture recording: https://www.youtube.com/watch?v=L1OBRtfPS34
Slides: https://drive.google.com/file/d/1b8WiBk_lcB3ue-jZMLijSUMLj6S...
Note: The lecture talks mostly on always-on agents and not necessarily mult-agent system.
My brain just defaults to "there is something wrong with this" as a result.