Re:HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends...
by nomel on Friday March 31, 2023 @03:05PM
(#35391802)
I think an attention/focus system might be applicable. I think humans have the same limitations, with tricks to work around it. As Jim Keller once said on an Lex Fridman interview, a good engineer is one that can jump around between the different levels of abstraction. We think in a high level, then "focus" and jump down when needed.
I think something like this could be hacked together, with summarization and parallel "focus threads", containing prompts that focus on details. These could be pruned/merged back together, to add to the "summary" higher level abstractions.
I use this approach already, to some extent, when a conversation gets too long and I need specific details. I'll start a new prompt, include a high level summary, and then "focus" on specific ideas to get more specific answers about a particular detail.
I think something like this could be hacked together, with summarization and parallel "focus threads", containing prompts that focus on details. These could be pruned/merged back together, to add to the "summary" higher level abstractions.
I use this approach already, to some extent, when a conversation gets too long and I need specific details. I'll start a new prompt, include a high level summary, and then "focus" on specific ideas to get more specific answers about a particular detail.