News for hackers. Stuff that matters.
Re:Anthropic Subscriptions Offer 5x+ More Value Than OpenAI by ethbr1 on Tuesday October 06, 2026 @11:41AM (#49980169)
> First, the form factor of GPUs in data centers aren't the same as desktop GPUs, so you couldn't use them even if you wanted to in a normal rig.

With eGPU PCIe 3.0 or 4.0 x4 links (or even Thunderbolt), that essentially doesn't matter for inference.

You pay the bandwidth hit on model load / unload (a few seconds), but it's irrelevant for post-loaded inference.

Anyone hosting a high wattage GPU is going to be fine hosting in an external enclosure, most of which have generous extra-spec room.

And if they don't, if a flood of cheaper DC GPUs hit the used market, you can bet Chinese manufacturers will have enclosures that fit them available the day after.

There are no comments on this comment yet.