Re:Bonsai 27B: A 27B-Class Model that runs on a phone
by bigmadshoe on Wednesday July 15, 2026 @01:07AM
(#48916507)
Good point! I thought you meant splitting them and then doing inference with some kind of learned router while keeping all the split models loaded at once. What you're suggesting is pretty sensible.
[ Parent
| on HN ]
There are no comments on this comment yet.