We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for code generation

Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by tucnak on Thursday January 02, 2025 @01:54PM (#42577459)

There's a reason why you don't see frontier-grade AI researchers throwing around meaningless numbers to go with the most layman idea of a product in the field imaginable. The whole thing stinks. I reckon this is some kind of extortion scam intended to trick people into compromising IP.

[ Parent | on HN ]

Re:We fine-tuned Llama and got 4.2x Sonnet 3.5 accuracy for ... by samatdav on Thursday January 02, 2025 @11:28PM (#42582431)

I understand the concern but we don't need anyone's IP. Unfortunately, it is hard to provide fine-tuning solution without access to the codebase. We just think that using a large general-purpose model for a highly specific codebase with a lot of internal frameworks is not the best solution and want to try to improve it.

[ Parent | on HN ]