Re:A new way to build with Large Language Models
by sprobertson on Thursday February 09, 2023 @09:59PM
(#34735110)
I've wanted something like this for years! And just started building it myself last month (mostly for home automation). I like the multi-agent model, and the "thought" steps are pretty interesting. But how do you deal with context length with all the back and forth?
[ Parent
| on HN ]
Re:A new way to build with Large Language Models
by juberti on Thursday February 09, 2023 @10:49PM
(#34735374)
Current context lengths are usually more than adequate for these interactions; the details of each individual step within an execution only need to be retained until the final response is emitted.