Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by zitterbewegung on Tuesday March 14, 2023 @11:26AM
(#35153022)
Nothing much unsaid but huggingface has been doing this for smaller models. What is happening is they are distilling Davinci by using llama and it’s been done before .
But this performance will still page behind OpenAI for a bit but within a month or a few months we should have something almost comparable it’s just frustrating that Stanford is blocking the code and model release when it’s just a matter of time for a full copy to come out.
But this performance will still page behind OpenAI for a bit but within a month or a few months we should have something almost comparable it’s just frustrating that Stanford is blocking the code and model release when it’s just a matter of time for a full copy to come out.