News for hackers. Stuff that matters.
Re:Model Distillation in the API by msp26 on Thursday October 31, 2024 @03:18PM (#42010445)
But doesn't this fully lock you into using OpenAI's offerings? If you store the finetuning dataset yourself, you are free to use it on whatever model/provider/self hosting. And I'm finding it fairly straightforward to switch between providers at will. Plus it's nice to do additional programmatic validation on LLM outputs before using them for finetuning (e.g. standardizing country names, calculations).

Am I missing something?

Re:Model Distillation in the API by simonw on Thursday October 31, 2024 @04:08PM (#42010962)
Yes, total lockin.

Remember though, OpenAI and pretty much all of the other providers have things in their terms that roughly say you're not allowed to use their models to train models from other providers - so fine-tuning a model against synthetic data created using OpenAI is likely a terms violation anyway.

Re:Model Distillation in the API by janalsncm on Friday November 01, 2024 @04:08PM (#42021015)
Terms violation or not, it’s a common use case and a huge contributor to their traffic. If they actually enforced it people would move because the marginal quality benefits don’t justify indefinite lockin.