News for hackers. Stuff that matters.

A comment on Micron CEO Says Memory Supply Will Be Much Tighter in 2027 and 2028 Than in 2026. Parent comment

Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202... by PowerElectronix on Friday October 02, 2026 @04:08AM (#49931047)
Pure inference would have to compete with other service providers and even local hardware that becomes capable of running models for a price if hardware demand by openAI and Anthropic dwindles.

That is a very commodify market and as such I expect power cost per query ends up setting the pricing.

[ Parent | on HN ]
Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202... by TuxSH on Friday October 02, 2026 @04:53PM (#49938491)
> if hardware demand by openAI and Anthropic dwindles

Would it ever? Demand for inference (and I suppose the same applies for training) _increases_ when models get cheaper.

I suppose real risk is that one player aggressively cuts margins (say, AWS) and others follow suite. However the release of increasingly more capable, exclusive closed-weight models prevents this to an extent.

[ Parent | on HN ]