Making AMD GPUs competitive for LLM inference

Re:Making AMD GPUs competitive for LLM inference by latchkey on Friday August 11, 2023 @01:42PM (#37091530)

Speaking from having run tens of thousands of both 580 and 480, they weren't just rebranded. Maybe on paper they seemed similar, but they didn't run similar.

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by bibanez on Saturday August 12, 2023 @10:18AM (#37100449)

I’m curious, where would you run so many gpus? Quality control?

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by latchkey on Saturday August 12, 2023 @11:30AM (#37101173)

7 datacenters in the US

[ Parent | on HN ]