News for hackers. Stuff that matters.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by dfhg on Monday December 25, 2023 @12:36AM (#38760121)
Are there public examples of working products using RAG, compared with fine-tuning or training from scratch?
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by tinco on Monday December 25, 2023 @01:43AM (#38760393)
The OpenAI assistants API is an implementation of a RAG pipeline. It performs both RAG on any documents you upload, and on any conversation you have with it that exceeds the context.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by c0pium on Monday December 25, 2023 @01:14AM (#38760282)
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by regularfry on Monday December 25, 2023 @10:22AM (#38763323)
Amazon Q is (at least partially) a RAG implementation.
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by aik on Monday December 25, 2023 @01:13PM (#38764719)
Not public but internally I wrote a tool to help us respond to RFPs. You pass in a question from a new RFP and it outputs surprisingly great answers most of the time. Is writing 75%+ of our RFP responses now (naturally we review and adjust sometimes and as needed). And best of all it was very quickly hacked together and it’s actually useful. Copied questions/answers from all previous ones into a doc, and am using OpenAI embeddings api + FAISS vector db + GPT-4 to load the chunks + store the embeddings + process the resulting chunks.