News for hackers. Stuff that matters.
Re:The Dual LLM pattern for building AI assistants that can ... by williamcotton on Monday May 15, 2023 @04:13PM (#35953863)
I think the two-layer approach is worthwhile if only for limiting tokens!

Here’s an example of what I mean:

https://github.com/williamcotton/transynthetical-engine#brow...

By keeping the main discourse between the user and the LLM from containing all of the generated code and instead just using that main “thread” to orchestrate instructions to write code it allows for more back-and-forth.

It’s a good technique in general!

I’m still too paranoid to execute instructions via email without a very limited set of abilities!

There are no comments on this comment yet.