Re:GPT-3.5 Turbo fine-tuning and API updates
by irthomasthomas on Wednesday August 23, 2023 @05:51PM
(#37242338)
Yes, this is for training your own public facing chatbot. So that it does not easily break character and go wildly off-script, like bing, and start ranting at the old lady trying to check her balance. This will likely dramatically increase the number of chatgpt customer service bots in the near future, but on the up side, at least they wont all be regurgitating that "as a language model" shtick. That is if they are willing to pay to beat it out him.
> I generally recommend retrieval
Yes that's what everyone's saying and it's also what we're working on. I was wondering what fine-tuning may be used for. Are there use cases where fine-tuning might be worth it (esp; given all the hard work it entails)?
> akin to a student taking a test with open notes they can refer to, rather than trying to remember a textbook they read a week ago
Excellent analogy! Thanks!