News for hackers. Stuff that matters.
Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by ksec on Sunday October 01, 2023 @12:47AM (#37722655)
> I look at cost versus VRAM. Fitting a model in one PC helps. Fitting a model on one GPU helps more.

Yes unfortunately I dont see 128GB VRAM coming any time soon even with 512bit GDDR Memory Interface.

Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by frognumber on Sunday October 01, 2023 @06:42PM (#37731711)
I would very, very gladly pay for a GPU which took normal DIMMs, and let me get up to 256GB.

I can buy a 32GB DIMM for <$50. Eight of them would do it for $400.

YES, I know the performance hit, but I'm not limited so much by performance as by which models fit. That's true of a lot of other people too.

Only way I can see this happening is if Intel or AMD get serious about AI. This would seriously undercut NVidia's business.