Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc...
by dfhg on Monday December 25, 2023 @12:36AM
(#38760121)
Are there public examples of working products using RAG, compared with fine-tuning or training from scratch?
[ Parent
| on HN ]
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc...
by tinco on Monday December 25, 2023 @01:43AM
(#38760393)
The OpenAI assistants API is an implementation of a RAG pipeline. It performs both RAG on any documents you upload, and on any conversation you have with it that exceeds the context.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc...
by c0pium on Monday December 25, 2023 @01:14AM
(#38760282)
Copilots use RAG:
https://www.microsoft.com/en-us/research/group/dynamics-insi...
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc...
by regularfry on Monday December 25, 2023 @10:22AM
(#38763323)
Amazon Q is (at least partially) a RAG implementation.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc...
by aik on Monday December 25, 2023 @01:13PM
(#38764719)
Not public but internally I wrote a tool to help us respond to RFPs. You pass in a question from a new RFP and it outputs surprisingly great answers most of the time. Is writing 75%+ of our RFP responses now (naturally we review and adjust sometimes and as needed). And best of all it was very quickly hacked together and it’s actually useful. Copied questions/answers from all previous ones into a doc, and am using OpenAI embeddings api + FAISS vector db + GPT-4 to load the chunks + store the embeddings + process the resulting chunks.