Making AMD GPUs competitive for LLM inference

Re:Making AMD GPUs competitive for LLM inference by nomel on Monday December 23, 2024 @10:29PM (#42499521)

This is discussed in the lex Friedman episode. AMD’s own demo would kernel panic when run in a loop [1].

[1] https://youtube.com/watch?v=dNrTrx42DGQ&t=3218

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by kranke155 on Tuesday December 24, 2024 @04:19AM (#42500712)

Interesting. I wonder if focusing on GPUs and CPUs is something that requires two companies instead of one, whether the concentration of resources just leads to one arm of your company being much better than the other.

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by halJordan on Tuesday December 24, 2024 @08:07PM (#42506147)

Nvidia maintains a competitive cpu...

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by kranke155 on Wednesday December 25, 2024 @06:29AM (#42508282)

I had no idea. Thanks for sharing.

[ Parent | on HN ]