News for hackers. Stuff that matters.
Re:Stanford Alpaca, and the acceleration of on-device LLM de... by zitterbewegung on Tuesday March 14, 2023 @11:26AM (#35153022)
Nothing much unsaid but huggingface has been doing this for smaller models. What is happening is they are distilling Davinci by using llama and it’s been done before .

But this performance will still page behind OpenAI for a bit but within a month or a few months we should have something almost comparable it’s just frustrating that Stanford is blocking the code and model release when it’s just a matter of time for a full copy to come out.

There are no comments on this comment yet.