Ask HN: How do I train a custom LLM/ChatGPT on my own documents in Dec 2023?

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by ilaksh on Monday December 25, 2023 @02:43AM (#38760632)

I forgot about the continuous pre-training thing. How long and how much did they cost on Bedrock?

I had tried to suggest continuous pre-training to my client but it seemed expensive and when I mentioned that he lost interest and just kept wanting me to do fine tuning.

Also to clarify, did you do the continuous pre-training or RAG? And did you compare the efficacy of one or the other or both?

[ Parent | on HN ]

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by benjaminwootton on Monday December 25, 2023 @02:47AM (#38760652)

I used the RAG knowledge bases for most of my testing described above.

I got a toy demo up and running with continuous pre-training but haven’t evaluated it unfortunately.

[ Parent | on HN ]