News for hackers. Stuff that matters.

A comment on Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W. Parent comment

Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by colonelspace on Monday September 30, 2024 @12:31PM (#41699073)
Indeed two 4090s provide more CUDA/RT/Tensor cores, but the A6000 gives you 48GB of RAM which can end up making the card faster at certain tasks that would require swapping out data to system RAM on a 24GB card.
[ Parent | on HN ]
Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by atemerev on Tuesday October 01, 2024 @03:05PM (#41712799)
Two 4090s have 48G too. For most (if not all) LLM-related tasks, there is no difference how many cards are used for the same amount of VRAM.
[ Parent | on HN ]