News for hackers. Stuff that matters.

A comment on Ask HN: How do I train a custom LLM/ChatGPT on my own documents in Dec 2023?. Parent comment

Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by 3abiton on Monday December 25, 2023 @07:20AM (#38762017)
Llamaindex has so mucu potential. Any benchmarks on performance compared to fine-tuning?
[ Parent | on HN ]
Re:Ask HN: How do I train a custom LLM/ChatGPT on my own doc... by sroecker on Monday December 25, 2023 @11:22AM (#38763807)
You probably don't need fine-tuning, at least if it's just new content (and no new instructions). It may even be detrimental, since LLMs are als good at forgetting: https://twitter.com/abacaj/status/1739015011748499772
[ Parent | on HN ]