News for hackers. Stuff that matters.
Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by sgerenser on Tuesday October 06, 2026 @07:10AM (#49976813)
$4k doesn’t even buy you a DGX spark these days. You can get a Ryzen AI max 128GB machine for a bit less than $4k but the models you can run on there aren’t even close to Opus 4.8.
Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by hajile on Tuesday October 06, 2026 @07:25AM (#49976925)
Amazon recently moved $8B in GPUs to a SPV to hide away their expenses. Oracle warned their data center isn’t going to be on schedule. Worst of all, none of the big players are reporting enough deprecations to match up with GPU sales.

All this indicates to me that loads of GPUs were only purchased on paper or are sitting in warehouses unused. This almost certainly means a drop in orders followed by a drop in RAM prices (though that would indicate a demand drop to investors, so maybe it’s better for stock prices to keep paying to bills bigger warehouses and stuff them full of unused GPUs).

The second RAM prices normalize, local LLM becomes much cheaper. A machine that doesn’t make much sense at $10-15k suddenly becomes a lot more feasible at $3-5k. If those stored GPUs flood the market, we might see even bigger price drops.

Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by AtHeartEngineer on Tuesday October 06, 2026 @08:00AM (#49977199)
that's a wild theory. You think there are really warehouses of GPUs that they are just sitting on until data centers are built, that will just all of a sudden flood the market?

First, the form factor of GPUs in data centers aren't the same as desktop GPUs, so you couldn't use them even if you wanted to in a normal rig.

Second, from a business perspective that doesn't make a lot of sense. It's much more likely that GPUs are going to the highest bidder/large contracts who are scooping them up to populate/upgrade data centers that are in operation because they are going to get more money per gpu on newer hardware. The "old" hardware might go to a warehouse to be auctioned to the highest bidder or go to a data center coming online, but I highly doubt they are sitting on market wrecking amounts of GPUs just waiting to flood the market. When they go bankrupt and they have to sell a datacenter or two, those datacenters being parted out as part of a bankruptcy deal I could see. Warehouses full of unused GPUs doesnt make any sense to me though.

Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by irthomasthomas on Tuesday October 06, 2026 @09:59AM (#49978622)
"Microsoft Is Warehousing An Estimated $50 Billion to $100 Billion In GPUs" https://www.wheresyoured.at/wherere-all-the-ai-chips/
Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by thatsabadlook on Tuesday October 06, 2026 @11:33AM (#49980049)
It makes sense if you consider that maybe all of these companies are colluding to forward a shared agenda. It is happening whether it makes sense or not. So there's that too.
Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by ethbr1 on Tuesday October 06, 2026 @11:41AM (#49980169)
> First, the form factor of GPUs in data centers aren't the same as desktop GPUs, so you couldn't use them even if you wanted to in a normal rig.

With eGPU PCIe 3.0 or 4.0 x4 links (or even Thunderbolt), that essentially doesn't matter for inference.

You pay the bandwidth hit on model load / unload (a few seconds), but it's irrelevant for post-loaded inference.

Anyone hosting a high wattage GPU is going to be fine hosting in an external enclosure, most of which have generous extra-spec room.

And if they don't, if a flood of cheaper DC GPUs hit the used market, you can bet Chinese manufacturers will have enclosures that fit them available the day after.

Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by bluecalm on Tuesday October 06, 2026 @02:06PM (#49981956)
>>The second RAM prices normalize, local LLM becomes much cheaper. A machine that doesn’t make much sense at $10-15k suddenly becomes a lot more feasible at $3-5k. If those stored GPUs flood the market, we might see even bigger price drops.

Yeah but it's unlikely to happen in coming 2-3 years (at least) and then the SOTA models are going to be a completely different animals.

Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by thatsabadlook on Tuesday October 06, 2026 @07:23AM (#49976912)
On a single 3090 while offloading experts to RAM you can run qwen 3.8 next. Which yea is about 2.5k new and yep about opus 4.8.