News for hackers. Stuff that matters.

A comment on GPT-4. Parent comment

Re:GPT-4 by luxcem on Tuesday March 14, 2023 @02:27PM (#35156235)
The embodied cognition is still a theory, can consciousness appears in a simulated brain without a physical body? Maybe. What seems to be a limiting factor for now it's that current models don't experience existence, they don't have memory and don't "think" outside of the prompt. They are just instances of code launched and destroyed as soon as their task is done.

Right now it's possible to simulate memory with additional context (eg system prompt) but it doesn’t represent existence experienced by the model. If we want to go deeper the models need to actually learn from their interaction, update their internal networks and have some capabilities of self reflection (ie "talking to themselves").

I'm sure that's highly researched topic but it would demands extraordinary computational power and would cause lot of issues by letting such an AI in the wild.

[ Parent | on HN ]
Re:GPT-4 by kordlessagain on Tuesday March 14, 2023 @02:51PM (#35156620)
Embeddings via ada-002 give us a way to update the model in real time. Using Weaviate, or another dense vector engine, it is possible to write "memories" to the engine and then search those with concepts at a subsequent inferencing step. The "document models" that the engine stores can be considered a "hot model".
[ Parent | on HN ]
Re:GPT-4 by bobvanluijt on Tuesday March 14, 2023 @03:04PM (#35156823)
Yeah - it will become available as a multi2vec Weaviate module as well in due time.
[ Parent | on HN ]