News for hackers. Stuff that matters.
Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by vonneumannstan on Wednesday January 08, 2025 @11:12AM (#42635647)
And if his volume grows 100x should we expect him to run his company off gaming gpus? Just because you can do something doesn't mean you should or that it's ideal.

There's a reason large companies are buying H100s and not 4090s. Despite what you guys think, serious ML work isn't done on the consumer cards for many reasons: FP16/FP8 TFLOPS, NVLINK, power consumption, physical space, etc.

There are no comments on this comment yet.