Re:Run a 1T parameter model on a 32gb Mac by streaming tenso...
by a7om_com on Thursday March 26, 2026 @11:46AM
(#47531934)
The Qwen 3.5 MoE local performance numbers are striking but the cloud pricing picture for the same models is equally interesting. On inference platforms right now Qwen class models are running significantly cheaper than closed equivalents, open source has about an 81% pricing advantage on equivalent platforms. The local vs cloud crossover math gets genuinely interesting for MoE models because the sparse expert loading that makes Hypura useful locally is the same property that makes cloud inference cheaper per token. Worth knowing both sides of that equation when deciding where to run.
[ Parent
| on HN ]
There are no comments on this comment yet.