Re:Running Qwen3.8 at 255 tok/s on a single 5090
by serf on Wednesday October 14, 2026 @12:09AM
(#50082282)
having used both I think bonsai 2 is far ahead, but it still calls tools too often. This isn't always a bad thing, but it seems to have more tool calls per successful run than other equivalents; like it's in-grained to triple check things.
might be a good characteristic for a quantized model to have ..
might be a good characteristic for a quantized model to have ..