News for hackers. Stuff that matters.

A comment on Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W. Parent comment

Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by colonelspace on Friday September 27, 2024 @08:00PM (#41676706)
NVIDIA RTX 6000 Ada Generation

Although they retail for more than $4k.

The previous generation RTX A6000 is probably what they're referring to above.

[ Parent | on HN ]
Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by atemerev on Sunday September 29, 2024 @05:45PM (#41690970)
It is $7.5k, and slower than 4090 compute-wise. Two 4090s (which are cheaper than A6000) are strictly superior to it.
[ Parent | on HN ]
Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by colonelspace on Monday September 30, 2024 @12:31PM (#41699073)
Indeed two 4090s provide more CUDA/RT/Tensor cores, but the A6000 gives you 48GB of RAM which can end up making the card faster at certain tasks that would require swapping out data to system RAM on a 24GB card.
[ Parent | on HN ]
Re:Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W by atemerev on Tuesday October 01, 2024 @03:05PM (#41712799)
Two 4090s have 48G too. For most (if not all) LLM-related tasks, there is no difference how many cards are used for the same amount of VRAM.
[ Parent | on HN ]