News for hackers. Stuff that matters.
Re:GPT-3.5 Turbo fine-tuning and API updates by GaggiX on Tuesday August 22, 2023 @03:20PM (#37227371)
They would need to store and load the model, even if I imagine that they are using something similar to LoRA to finetune their models.
Re:GPT-3.5 Turbo fine-tuning and API updates by swyx on Tuesday August 22, 2023 @03:47PM (#37227669)
i would guess that the ideal price is also to raise the charge to make finetuning a last resort rather than a first resort; its probably much better cost- and research-wise if everybody just prompts the same model than silo off in their own minimodels.
Re:GPT-3.5 Turbo fine-tuning and API updates by sebzim4500 on Tuesday August 22, 2023 @05:16PM (#37228637)
I don't think I'd consider it a 'last resort', since a lot of people will be choosing between finetuned GPT-3.5 and non-finetuned GPT-4, in which case finetuning is the cheap option.