News for hackers. Stuff that matters.

A comment on We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for code generation.

Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by Imnimo on Thursday January 02, 2025 @11:10AM (#42575661)
4.2x doesn't mean anything if you don't tell me what "accuracy" Sonnet 3.5 had.
[ Parent | on HN ]
Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by samatdav on Thursday January 02, 2025 @11:56PM (#42582586)
I agree. Our local early results were promising were a higher percentage of code change requests produced a functionally correct output. We will post more metrics and data in the future.
[ Parent | on HN ]