News for hackers. Stuff that matters.

A comment on /story/42078536. Parent comment

Re: by cratermoon on Thursday November 07, 2024 @08:26PM (#42083179)
Any kind of search prior for content to provide as context to the LLM prompt is RAG. The goal is to leverage traditional information retrieval as a source of context. https://cloud.google.com/use-cases/retrieval-augmented-gener...

I'm currently working on a demonstration/POC system using my ElasticSearch as my content source, generating embeddings from that content, and passing them to my local LLM.

[ Parent | on HN ]
Re: by petesergeant on Thursday November 07, 2024 @08:47PM (#42083299)
It would be cool to be talking to other people about the RAG systems they’re building. I’m working in a silo at the moment, and pretty sure that I’m reinventing a lot of techniques
[ Parent | on HN ]