Re:On the Catastrophic Risk of AI
by Tostino on Thursday June 01, 2023 @11:08AM
(#36152132)
Completely agree here.
And the fact of the matter is, long term memory is actively being worked on. You can already approximate reasonably with a Vector DB and embeddings, feeding the relevant results into the context.
This isn't even getting into using things like Tree of Thought techniques to improve reasoning abilities and limit the search space for each portion of the problem to a reasonable size.
And the fact of the matter is, long term memory is actively being worked on. You can already approximate reasonably with a Vector DB and embeddings, feeding the relevant results into the context.
As is increasing the "working memory" (context size) in a more efficient manner: https://arxiv.org/abs/2305.16300
This isn't even getting into using things like Tree of Thought techniques to improve reasoning abilities and limit the search space for each portion of the problem to a reasonable size.