News for hackers. Stuff that matters.

A comment on Making AMD GPUs competitive for LLM inference. Parent comment

Re:Making AMD GPUs competitive for LLM inference by llama-mini on Tuesday December 24, 2024 @12:04AM (#42499843)
From Lamini, we have a private AMD GPU cluster, ready to serve any one who want to try MI300x or MI250 with inference and tuning.

We just onboarded a customer to move from openai API to on-prem solution, currently evaluating MI300x for inference.

Email me at my profile email.

[ Parent | on HN ]

There are no comments on this comment yet.