News for hackers. Stuff that matters.
Re:More Agents Is All You Need: LLMs performance scales with... by smusamashah on Sunday April 07, 2024 @12:00AM (#39958097)
Could multiple agents be used such that tokens emitted from LLM A is passed to B and output of B is passed to A meaning 2 agents will be being used to generate an output in a simple round Robin way? Both will share context in this case. My computer isn't big enough run two large models but this can be tried on tiny models perhaps.

I realize that for more than two and very specialised agents this will require some intelligent way to pass the output to specialist agents only. And also this means that their must be some overlap between the agents.

Re:More Agents Is All You Need: LLMs performance scales with... by Sharlin on Sunday April 07, 2024 @01:04AM (#39958301)
That is what’s already been done under the term "multi-agent". This paper argues that there’s no need for any such message-passing or context sharing, you just literally run the same query several times on the same model, fully independently, and then pick a "typical" reply according to some similarity metric.
Re:More Agents Is All You Need: LLMs performance scales with... by xcv123 on Sunday April 07, 2024 @02:49AM (#39958736)
The paper says that it enhances multi-agent methods. It is not a replacement for that. It's an enhancement for existing methods.
Re:More Agents Is All You Need: LLMs performance scales with... by Sharlin on Monday April 08, 2024 @02:50AM (#39966922)
Running the same query several times on the same model and taking the consensus opinion is still a multi-agent method.