Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs
by ryao on Tuesday January 07, 2025 @02:08AM
(#42620107)
Inference presumably will run faster on a 5090. If the 5x memory bandwidth figure holds, then token generation would run 5 times faster. That said, people in the digits discussion predict that the memory bandwidth will be closer to 546GB/sec, which is closer to 1/3 the memory bandwidth of the 5090, so a bunch of 5090 cards would only run 3 times faster at token generation.
[ Parent
| on HN ]
There are no comments on this comment yet.