Re:Nvidia deliberately kept GPU prices high through circular...
by ericd on Saturday November 14, 2026 @09:34PM
(#50503420)
[delayed]
[ Parent
| on HN ]
Re:Nvidia deliberately kept GPU prices high through circular...
by satvikpendem on Saturday November 14, 2026 @10:04PM
(#50503578)
Tokens per second is slower on most local setups than cloud models.
Re:Nvidia deliberately kept GPU prices high through circular...
by ericd on Saturday November 14, 2026 @10:07PM
(#50503591)
We're talking about RTX Pro 6000s, local models on those are not slower than cloud models. With MTP, you're generally at 200-300 tps on one of the big MoE models in single stream in code generation (the small MTP models tend to be better at code token prediction than prose). The big cloud models are typically <100 tps.