Re:Ternary Bonsai: Top Intelligence at 1.58 Bits
by happygoose on Monday April 20, 2026 @11:18PM
(#47844102)
unfortunately, there doesn't seem to be a clear way to fine-tune these models yet. excited for when that happens though.
Nonetheless, the Prism Bonsai models are impressive for their size. Where it falls apart is with knowledge. It has good prose/logic for a tiny model, and it's fast even on modest hardware, but it hallucinates a lot. Which makes sense. You can't fit the world's data in a couple of gigabytes. But, as a base model for fine-tuning for use cases where size matters, it's probably a great choice.