Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Fine-tuned small LLMs can beat large ones with programmatic data curation. Parent comment
I think this is called “logit distillation” which is a particular form of distillation but not the only one.
> so you wouldn't be able to do that with fine-tuning APIs (OpenAI + Google in our blog post)
Dististillation from competitors' API is so common it has been given a name: it's called “distealing”.
There are no comments on this comment yet.
I think this is called “logit distillation” which is a particular form of distillation but not the only one.
> so you wouldn't be able to do that with fine-tuning APIs (OpenAI + Google in our blog post)
Dististillation from competitors' API is so common it has been given a name: it's called “distealing”.