News for hackers. Stuff that matters.

A comment on Creating AI assistant with GPT and Ruby and Redis using embeddings. Parent comment

Re:Creating AI assistant with GPT and Ruby and Redis using e... by dmix on Wednesday April 26, 2023 @05:43PM (#35720426)
It's more than just optimizing for space (which is still going to be important), it's also about using vector databases to seed the data from a wider dataset and translating that into something the AI can use. I mean technically in the far future you could dump a whole database into the 'context' and work off of it, but Vector DBs will fill that role in the meantime and add a memory layer on top of it for future queries.
[ Parent | on HN ]
Re:Creating AI assistant with GPT and Ruby and Redis using e... by redskyluan on Wednesday April 26, 2023 @06:01PM (#35720603)
Can't Agree with that more.

LLMs should not be trained to simply memorize information. Instead, they should be designed to understand and identify patterns in the data, and use the knowledge stored in vector databases to organize and summarize information.

Vector databases can be used to store and organize knowledge in a way that is more accessible to LLMs. By using vector representations, LLMs can easily access and manipulate knowledge, allowing them to more effectively process and analyze large amounts of information.

[ Parent | on HN ]