You are definitely right, mrgordon - this isn't an infinite scaling, "one extra copy cost essentially nothing," software issue. Video cards are physical. You can't just sell more copies with almost zero marginal cost like software. Each video card is a physical good that is subjected to all those physical laws.

I was not trying to deny the corporeality of GPU's (or cpu and memory), only that there might be an oversupply given the rate of buy up of these things and the amount of start ups who have brought these things and will fail and liquidate or liquidate hardware as they pivot or go into just offering inference.

Secondly that the frontier model providers will not necessarily want to buy these up as the aforementioned lower demand for training (or costly and memory intensive training) and cost of inference goes down (and possibly requests as the models get better or at least plateau).

Further TPU's and if model weights do eventually stabilize then ASIC's might make more sense.

And lastly as models improve and make less mistakes the requirement trying things in parallel traditional compute may also go down. I think their is a quantity intercept (The demand for compute if it cost nothing would be a finite number and may go down rather then up with advancements in cheaper inference and accuracy) for compute both AI inference and traditional compute.

I think there is a question of how much of that demand is real. If GPUs are sitting unused in boxes and/or if NVDA has been artificially juicing demand either through basically buying them from themselves or selling them to China through an intermediary then the 10x demand comes into question.

That leaves the real buyers who are also starting to run low on capital.

Finally, demand doesn't need to go to zero for there to be a price correction. Just dipping from insane demand to elevated levels would lead to a significant price drop.

real time visual data processing for these applications seems to me to not be that expensive and the thinking part will be done as a swarm. There is some real quantity intercept for the demand of compute that does change over time but one can imagine it going down with better inference not to mention ASIC's.

I think there are two sides that want a particular outcome one want gpu's to get cheaper (like I admit I do), others want there investment to work out (both might want to huff copium at some point, who is huffing here is not easy to tell).