Finetuning Large Language Models

Re:Finetuning Large Language Models by amluto on Saturday April 22, 2023 @10:47AM (#35667086)

An answer from OpenAI will be very biased. OpenAI will happily take your money to query their models with long prompts. They will also happily take your money to compute embeddings and thus help you search (and lock you in!).

But, as far as I know, OpenAI will not help you fine-tune, they will not run a fine-tuned model for you, and they would probably prefer that you use their models over open models that can be fine tuned.

(None of this is to say that fine tuning is better. I’m just saying that OpenAI has a strong commercial bias.)

[ Parent | on HN ]

Re:Finetuning Large Language Models by spenczar5 on Saturday April 22, 2023 @10:50AM (#35667118)

What about their fine tuning API? https://platform.openai.com/docs/guides/fine-tuning

[ Parent | on HN ]

Re:Finetuning Large Language Models by sysstemlord on Saturday April 22, 2023 @11:34AM (#35667588)

I saw a video tutorial about it and if i understood correctly, the API will automatically include whatever you "tuned" in the prompt, making it just as costly i guess. But i could be wrong as it was late and i was getting sleepy.

[ Parent | on HN ]

Re:Finetuning Large Language Models by amluto on Saturday April 22, 2023 @10:53AM (#35667140)

Interesting. But not supported for their chat models.

I like how the fine-tuning page talks about how fine tuning is supposedly better, though.

[ Parent | on HN ]