News for hackers. Stuff that matters.
Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by valine on Saturday September 30, 2023 @11:25PM (#37722245)
You can split your AI models between two 4090s and have access to 48GB of VRAM for less money. You do take a slight performance hit compared to running on one card, but the 4090 also has more CUDA cores which help mitigate the slowdown.
Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by osti on Sunday October 01, 2023 @12:03AM (#37722412)
Is it easy to split your model onto multiple gpus though?
Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by omneity on Sunday October 01, 2023 @01:57AM (#37723088)
How do you split your model to train on multiple gpus while pooling VRAM?
Re:Nvidia's RTX 5000 Ada Now Available: AD102 with 32GB of G... by amitport on Sunday October 01, 2023 @03:58AM (#37723773)
deepspeed