News for hackers. Stuff that matters.
Re:GPT-3.5 Turbo fine-tuning and API updates by rchtwlm on Wednesday August 23, 2023 @04:55AM (#37233430)
>For example, if one would want to use an LLM to answer questions regarding a large, private knowledge base, would it make sense to fine-tune a model on this knowledge base?

No, it does not. Language models are not for storing or accessing data, as you have noticed when you refer to hallucination. If you wish to store and access data, use embeddings + a vector database. Fine tuning is for changing what kind of language the model generates. For example, if you want an AI that writes like a journalist you fine tune it on newspaper articles. If you want an AI that writes reviews, you fine tune it on reviews. And so on.

Re:GPT-3.5 Turbo fine-tuning and API updates by bambax on Wednesday August 23, 2023 @06:36AM (#37233971)
Ok, thanks, but do you really need fine tuning for that, can't you tell the model in the prompt?
Re:GPT-3.5 Turbo fine-tuning and API updates by hnuser123456 on Wednesday August 23, 2023 @07:43AM (#37234388)
It seems like LLMs can easily start to "forget" requests to modify their style or tone if it's a small part of the overall context, and they drift back towards the style or tone they naturally have (or were encouraged to have by their original trainers.)