News for hackers. Stuff that matters.
Re:Model Distillation in the API by janalsncm on Thursday October 31, 2024 @03:29PM (#42010550)
Part of the point of distilling from their models is that I control the model, its availability, and its cost to me. So while this may be a convenient feature, unless I can download the weights it wouldn’t replace my workflow.

This does raise the bar for any future startups though. If your plan was to distill GPT4 outputs and lease the weights to me through a REST API, I probably won’t be interested.

There are no comments on this comment yet.