News for hackers. Stuff that matters.
Re:Llama 3.1 Official Launch by lostmsu on Wednesday July 24, 2024 @01:11PM (#41059291)
With 2x 4090 you will have 2x speed of RTX 6000 A. So same energy per token.

Will need more space, true.

Re:Llama 3.1 Official Launch by angoragoats on Wednesday July 24, 2024 @03:42PM (#41061084)
Yeah, after digging more into RTX 6000 Ada cards, I don't see any way they'd be more economical even over many years, no matter how you slice it.