Re:GPT-3.5 Turbo fine-tuning and API updates
by josephg on Tuesday August 22, 2023 @04:29PM
(#37228131)
From the article:
> Early tests have shown a fine-tuned version of GPT-3.5 Turbo can match, or even outperform, base GPT-4-level capabilities on certain narrow tasks.
It sounds like it really depends on what you're doing.
Re:GPT-3.5 Turbo fine-tuning and API updates
by bookmark1231 on Tuesday August 22, 2023 @09:16PM
(#37230726)
Given that GPT4 is essentially 16 different ensembled GPT3.5s[1] that’s not too surprising
[1] https://www.semianalysis.com/p/gpt-4-architecture-infrastruc...
The real alternative to a finetuned GPT-3.5-turbo is still the base model with a very very complicated system prompt.