News for hackers. Stuff that matters.
Re:Microgpt by jeremyjh on Sunday March 01, 2026 @07:56AM (#47206288)
Fine tuning does not make a model any smaller. It can make a smaller model more effective at a specific task, but a larger model with the same architecture fine-tuned on the same dataset will always be more capable in a domain as general as programming or software design. Of course, as architecture and related tooling improves the smallest model that is "good enough" will continue to get smaller.

There are no comments on this comment yet.