Re:A new semantic chunking approach for RAG
by kewp on Wednesday September 25, 2024 @12:14AM
(#41643607)
What is RAG?
[ Parent
| on HN ]
Re:A new semantic chunking approach for RAG
by daemonologist on Wednesday September 25, 2024 @12:17AM
(#41643631)
Retrieval Augmented Generation - using search (usually with some kind of semantic component) to find relevant context and provide it to the language model to help it respond, give it knowledge about a specific document, etc.
Re:A new semantic chunking approach for RAG
by kewp on Wednesday September 25, 2024 @12:20AM
(#41643652)
Oh right, I remember now. Thank you for explaining it
Re:A new semantic chunking approach for RAG
by Sai_Praneeth on Wednesday September 25, 2024 @12:17AM
(#41643627)
Retrieval Augmented Generation. Fancy way of saying, retrieve chunks from your document corpus similar to your input using a similarity (mostly cosine) of embedding vectors of the chunks and input vectors, then inject those relevant chunks into your prompt to the LLM. Useful for Document Intelligence.