Re:Introducing Agents in Haystack: Make LLMs resolve complex...
by Ozzie_osman on Monday April 03, 2023 @11:25PM
(#35434627)
My understanding is that the patterns are similar (in that you're enabling an LLM to use external tools/information), and all those patterns would fall under the "agents" pattern.
But, I think the difference is that WebGPT was actually fine-tuned / retrained for its specific use case, while the agents in these libraries just use the generic model without fine-tuning. My guess (and I'm not an expert here) is that fine-tuning these models for specific agent uses cases would probably result in better outcomes... Though as the models get more powerful, they might just perform well enough out of the box. (Also, some of the most recent OpenAI models don't support fine-tuning, and even for the ones that do, you'd need to generate the data to fine tune).
Re:Introducing Agents in Haystack: Make LLMs resolve complex...
by Sol- on Tuesday April 04, 2023 @01:19AM
(#35435404)
I think the ReAct paper also popularized this approach: https://arxiv.org/abs/2210.03629
Re:Introducing Agents in Haystack: Make LLMs resolve complex...
by broast on Tuesday April 04, 2023 @03:32AM
(#35436297)
Perhaps these papers are also just coincidence. This field is so new and this type of reasoned completion chaining seems like it was an inevitability. I imagine many other active gpt products that got started early hand rolled similar systems.
Introducing the mechanism of internal thought is very interesting, I wonder if there's a way to make it implicit in the model's architecture.