News for hackers. Stuff that matters.

A comment on We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for code generation. Parent comment

Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by doubtfuluser on Thursday January 02, 2025 @07:40AM (#42573925)
Any plans on distilling it down to an 8b model to enable it for pure local usage on most consumer hardware?
[ Parent | on HN ]
Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by samatdav on Thursday January 02, 2025 @11:32PM (#42582452)
Could be done in the future. Our current focus is highest accuracy. But there are no limitations on the models - just would depend on user preference of size/performance tradeoff.
[ Parent | on HN ]