It's faster and more accurate. Bonsai was a way to demonstrate how effective ternary quant is, and how much it accelerates throughput. If you try coding with it you'll find that it often makes mistakes with tool calls and other syntax related tasks.

This model has higher retention because of the weight complexity and the quant method we built, and the speed loss is compensated via kernel optimisations and speculative decoding.

Have you actually observed these issues specifically with the newer Bonsai 2 (and not the original Bonsai)?

having used both I think bonsai 2 is far ahead, but it still calls tools too often. This isn't always a bad thing, but it seems to have more tool calls per successful run than other equivalents; like it's in-grained to triple check things.

might be a good characteristic for a quantized model to have ..