Re:Nvidia Allegedly Engineered Scarcity by Funding AI Startu...
by kodoman on Saturday November 14, 2026 @07:51AM
(#50496630)
I was not trying to deny the corporeality of GPU's (or cpu and memory), only that there might be an oversupply given the rate of buy up of these things and the amount of start ups who have brought these things and will fail and liquidate or liquidate hardware as they pivot or go into just offering inference.
Secondly that the frontier model providers will not necessarily want to buy these up as the aforementioned lower demand for training (or costly and memory intensive training) and cost of inference goes down (and possibly requests as the models get better or at least plateau).
Further TPU's and if model weights do eventually stabilize then ASIC's might make more sense.
And lastly as models improve and make less mistakes the requirement trying things in parallel traditional compute may also go down. I think their is a quantity intercept (The demand for compute if it cost nothing would be a finite number and may go down rather then up with advancements in cheaper inference and accuracy) for compute both AI inference and traditional compute.
Secondly that the frontier model providers will not necessarily want to buy these up as the aforementioned lower demand for training (or costly and memory intensive training) and cost of inference goes down (and possibly requests as the models get better or at least plateau).
Further TPU's and if model weights do eventually stabilize then ASIC's might make more sense.
And lastly as models improve and make less mistakes the requirement trying things in parallel traditional compute may also go down. I think their is a quantity intercept (The demand for compute if it cost nothing would be a finite number and may go down rather then up with advancements in cheaper inference and accuracy) for compute both AI inference and traditional compute.