Re:GPT-3.5 Turbo fine-tuning and API updates
by bambax on Wednesday August 23, 2023 @06:36AM
(#37233971)
Ok, thanks, but do you really need fine tuning for that, can't you tell the model in the prompt?
Re:GPT-3.5 Turbo fine-tuning and API updates
by hnuser123456 on Wednesday August 23, 2023 @07:43AM
(#37234388)
It seems like LLMs can easily start to "forget" requests to modify their style or tone if it's a small part of the overall context, and they drift back towards the style or tone they naturally have (or were encouraged to have by their original trainers.)
No, it does not. Language models are not for storing or accessing data, as you have noticed when you refer to hallucination. If you wish to store and access data, use embeddings + a vector database. Fine tuning is for changing what kind of language the model generates. For example, if you want an AI that writes like a journalist you fine tune it on newspaper articles. If you want an AI that writes reviews, you fine tune it on reviews. And so on.