Re:Nvidia deliberately kept GPU prices high through circular...
by searealist on Sunday November 15, 2026 @02:15AM
(#50504758)
You aren't hitting almost 2x decode with speculation on a MoE model, but it's irrelevant. Electricity will cost most for most people than API will, even with free hardware. And 4-bit qwen next will be a major competitive disadvantage compared to larger models.
See also: https://github.com/niko1221/strata