News for hackers. Stuff that matters.
Re:Bonsai 27B: A 27B-Class Model that runs on a phone by bigmadshoe on Wednesday July 15, 2026 @01:07AM (#48916507)
Good point! I thought you meant splitting them and then doing inference with some kind of learned router while keeping all the split models loaded at once. What you're suggesting is pretty sensible.

There are no comments on this comment yet.