Re:Bonsai 27B: A 27B-Class Model that runs on a phone
by kaycey2022 on Tuesday July 14, 2026 @11:13PM
(#48915807)
Is that different from mixture of experts?
[ Parent
| on HN ]
Re:Bonsai 27B: A 27B-Class Model that runs on a phone
by int_19h on Wednesday July 15, 2026 @03:54AM
(#48917598)
Yes. A mixture of experts is a single model that activates different routes though the same weights, with the route possibly changing literally on every token. It's not experts as in a bunch of standalone models that are good at specific high-level tasks.