I have 1.5TB of VRAM on prem, not in a cloud. though arguably I count as a micro-datacenter now rather than a homelab.
Can you elaborate on your setup??
Re:Fuck Your AI Safeguards
by layla5alive on Saturday November 21, 2026 @12:18AM
(#50586186)
Two Gaudi2, fun times, as do I :)
Re:Fuck Your AI Safeguards
by roosterIllusi0n on Thursday November 19, 2026 @08:29PM
(#50569020)
Apple already has consumer hardware capable of doing this. But ram skyrocketed in price due to nvidia's collusion to raise prices.
There is no reason why these high speed interconnects would not filter down to consumer products. The only reason prices are not falling is because of the market collusion to keep prices high.
Right now its $2500 dollars for 4tb nvme raid and a pci-e switch capable of connecting a graphics card to that memory at 60GB/s. This is stuff you can buy during an artificial shortage.
I would have expected cheap 8tb nvme raid cards capable of 120GB/s to be available with the needed pci-e switching for less than that. Collusion denied it to you.
Re:Fuck Your AI Safeguards
by singleshot_ on Friday November 20, 2026 @10:19AM
(#50575904)
a RAM factory
How else are you going to get the terabyte+ of interconnected VRAM needed to run anything remotely frontier?