Re:AI agents but they're working in big tech
by 42lux on Tuesday August 06, 2024 @05:00PM
(#41175324)
Midjourney does not use an agent system, they use a single call.
Re:AI agents but they're working in big tech
by kgdiem on Tuesday August 06, 2024 @05:03PM
(#41175359)
I remembered reading that they used > 1, found this screengrab of discord on Reddit:
https://www.reddit.com/r/midjourney/comments/137bj1o/new_upd...
Re:AI agents but they're working in big tech
by 42lux on Tuesday August 06, 2024 @06:00PM
(#41175861)
It's still one call they just use a different llm now.
Re:AI agents but they're working in big tech
by simonw on Tuesday August 06, 2024 @05:06PM
(#41175382)
Is that multiple agents, or just multiple prompts? Are agents and prompts the same thing?
Re:AI agents but they're working in big tech
by kgdiem on Tuesday August 06, 2024 @05:23PM
(#41175535)
I am fairly certain that agents are the same thing as prompts (but also could be different).
Only the chat prompt/agent/whatever is connected to RAG; the image generator is DALLE and the router is a one-off call each time.
eg, it could be the same model with a different prompt or a different model + different prompt all together. AFAIU it’s just serving a different purpose than the other calls
Re:AI agents but they're working in big tech
by llm_trw on Tuesday August 06, 2024 @08:28PM
(#41177010)
Depends on who is trying to sell you what.
Currently all the tools on the market just use a different prompt and call it an agent.
I've build a tool using different models for each agent, e.g. whisper for audio decoding, llava to detect slides on the screen, open cv to crop the image, ocr to read the slide content, llm to summarize everything that's happening during the earnings call.
I kinda did this, too.
I made a 3 agent system — one is a router that parses the request and determines where to send it (to the other 2) one is a chat agent and the third is an image generator.
If the router determines an image is requested, the chat agent is tasked with making a caption to go along with the image.
It works well enough.