News for hackers. Stuff that matters.

A comment on Making AMD GPUs competitive for LLM inference. Parent comment

Re:Making AMD GPUs competitive for LLM inference by ryao on Tuesday December 24, 2024 @05:29PM (#42505409)
That is GH200 and it is likely due to an amd64 dependency in vLLM.
[ Parent | on HN ]

There are no comments on this comment yet.