Re:Token growth indicates future AI spend per dev
by jononor on Wednesday August 13, 2025 @03:01PM
(#44892421)
How long is foreseeable future? In 10 years I think LLM accelerator (GPU/NPU/etc) with 100 GB VRAM will cost under 2000 USD.
[ Parent
| on HN ]
Re:Token growth indicates future AI spend per dev
by root_axis on Wednesday August 13, 2025 @03:44PM
(#44892910)
VRAM prices have remained flat for the last decade, so no evidence of that coming.
Beyond that, running inference on the equivalent of a 2025 SOTA model with 100GB of VRAM is very unlikely. One consistent quality of transformer models has been the fact that smaller and quantized models are fundamentally unreliable, even though high quality training data and RL can boost the floor of their capabilities.