Re:Nvidia deliberately kept GPU prices high through circular...
by ericd on Saturday November 14, 2026 @10:07PM
(#50503591)
We're talking about RTX Pro 6000s, local models on those are not slower than cloud models. With MTP, you're generally at 200-300 tps on one of the big MoE models in single stream in code generation (the small MTP models tend to be better at code token prediction than prose). The big cloud models are typically <100 tps.
[ Parent
| on HN ]
There are no comments on this comment yet.