News for hackers. Stuff that matters.
Re:The Case for the Return of Fine-Tuning by stefanwebb on Sunday October 19, 2025 @04:34PM (#45637704)
Here's a blog post I wrote last week on the same topic: https://blog.oumi.ai/p/small-fine-tuned-models-are-all-you

I discuss a large-scale empirical study of fine-tuning 7B models to outperform GPT-4 called "LoRA Land", and give some arguments in the discussion section making the case for the return of fine-tuning, i.e. what has changed in the past 6 months

Re:The Case for the Return of Fine-Tuning by willybraun on Sunday October 19, 2025 @04:51PM (#45637849)
insightful, thanks