Re:Qwen3-Max-Thinking
by storystarling on Tuesday January 27, 2026 @03:05AM
(#46776867)
That assumes inference efficiency is static, which isn't really the case. Between aggressive quantization, speculative decoding, and better batching strategies, the cost per token can vary wildly on the exact same hardware. I suspect the margins right now come from architecture choices as much as raw power costs.
[ Parent
| on HN ]
There are no comments on this comment yet.