News for hackers. Stuff that matters.
Re:Model Distillation in the API by bangaladore on Thursday October 31, 2024 @02:43PM (#42010066)
> OpenAI GPT-4 => OpenAI GPT-3.5

I'm confused why you are mentioning 3.5 here. The weights aren't public, so you aren't actually running any derivative of GPT-3.5

Or am I mistaken. Can you clarify?

Re:Model Distillation in the API by Tiberium on Thursday October 31, 2024 @03:10PM (#42010352)
> distillation from larger models to smaller open-source models and smaller-closed source models

They don't limit it only to open-source models. And you can finetune 3.5 Turbo on OpenAI API.