News for hackers. Stuff that matters.
Re:Bonsai 27B: A 27B-Class Model that runs on a phone by CuriouslyC on Tuesday July 14, 2026 @07:13PM (#48914163)
The things it loses are all the things that google models are historically excellent at, so that's a reasonable performance. I think the take home here is that the 1 bit models are probably better, but it's not a slam dunk given advanced quantization techniques.

There are no comments on this comment yet.