News for hackers. Stuff that matters.

A comment on AMD Inference. Parent comment

Re:AMD Inference by skirmish on Wednesday October 02, 2024 @05:58PM (#41725349)
They prefer you pay $3,600 for AMD Radeon Pro W7900, 48GB VRAM.
[ Parent | on HN ]
Re:AMD Inference by anthonix1 on Wednesday October 02, 2024 @09:54PM (#41726585)
... which also has a much lower power cap
[ Parent | on HN ]
Re:AMD Inference by skirmish on Thursday October 03, 2024 @12:53PM (#41732485)
Not that much lower, 295W vs 355W, and for LLM inference VRAM bandwidth is the main bottleneck. But the price is ridiculous.
[ Parent | on HN ]